Apr 10 10:27:37 devstack cinder-volume[72396]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 10:27:37 devstack cinder-volume[72396]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:27:37 devstack cinder-volume[72396]: we strongly recommend against using it for new projects. Apr 10 10:27:37 devstack cinder-volume[72396]: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:27:37 devstack cinder-volume[72396]: framework. For more detail see Apr 10 10:27:37 devstack cinder-volume[72396]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:27:37 devstack cinder-volume[72396]: import eventlet # noqa Apr 10 10:27:39 devstack cinder-volume[72396]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72396) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:27:39 devstack cinder-volume[72396]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72396) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:27:39 devstack cinder-volume[72396]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72396) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:27:39 devstack cinder-volume[72396]: INFO dbcounter [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Registered counter for database cinder Apr 10 10:27:39 devstack cinder-volume[72396]: DEBUG oslo_db.sqlalchemy.engines [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72396) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:27:39 devstack cinder-volume[72396]: DEBUG dbcounter [-] [72396] Writer thread running {{(pid=72396) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:27:39 devstack cinder-volume[72396]: INFO cinder.rpc [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 10:27:39 devstack cinder-volume[72396]: INFO cinder.rpc [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 10:27:39 devstack cinder-volume[72396]: DEBUG oslo_db.sqlalchemy.engines [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72396) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:27:39 devstack cinder-volume[72396]: INFO cinder.volume.manager [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Determined volume DB was empty at startup. Apr 10 10:27:39 devstack cinder-volume[72396]: DEBUG cinder.volume.manager [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72396) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 10:27:39 devstack cinder-volume[72396]: INFO cinder.volume.manager [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 10:27:39 devstack cinder-volume[72396]: WARNING stevedore.named [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:27:39 devstack cinder-volume[72396]: WARNING castellan.key_manager [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:27:39 devstack cinder-volume[72396]: WARNING cinder.keymgr.conf_key_mgr [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:27:39 devstack cinder-volume[72396]: DEBUG cinder.volume.drivers.lvm [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72396) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 10 10:27:39 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_concurrency.processutils [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] CMD "cinder-rtstool verify" returned: 0 in 0.261s {{(pid=72396) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_db.sqlalchemy.engines [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72396) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:27:40 devstack cinder-volume[72396]: INFO cinder.rpc [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 10 10:27:40 devstack cinder-volume[72396]: INFO cinder.rpc [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 10 10:27:40 devstack cinder-volume[72396]: WARNING stevedore.named [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:27:40 devstack cinder-volume[72396]: WARNING castellan.key_manager [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:27:40 devstack cinder-volume[72396]: INFO cinder.volume.manager [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_db.sqlalchemy.engines [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72396) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:27:40 devstack cinder-volume[72396]: INFO oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Starting 1 workers Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Started child 72498 {{(pid=72396) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Full set of CONF: {{(pid=72396) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] ******************************************************************************** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Configuration options gathered from: {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] ================================================================================ {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] allow_availability_zone_fallback = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] allow_compression_on_image_upload = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] allowed_direct_url_schemes = [] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] api_rate_limit = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] auth_strategy = keystone {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] az_cache_duration = 3600 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_availability_zone = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_host = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_name = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_stats_polling_interval = 60 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backup_api_class = cinder.backup.api.API {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backup_name_template = backup-%s {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backup_use_same_host = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backup_use_temp_snapshot = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] chap_password = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] chap_username = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cinder_internal_tenant_project_id = 5e4209c292f548a6a4500979f21299e4 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cinder_internal_tenant_user_id = c9c38effb0504b1d93cd9b0f079893a4 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cloned_volume_same_az = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cluster = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] compression_format = gzip {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] compute_api_class = cinder.compute.nova.API {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] config_dir = [] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] config_source = [] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] control_exchange = openstack {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] debug = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] default_availability_zone = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] default_group_type = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72498]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] default_volume_type = lvmdriver-1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] disk_geometry = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] driver_client_cert = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] driver_client_cert_key = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] driver_data_namespace = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] driver_ssl_cert_path = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] driver_ssl_cert_verify = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] driver_use_ssl = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] enable_force_upload = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] enable_new_services = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] enable_unsupported_driver = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] enabled_backends = ['lvmdriver-1'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] enforce_multipath_for_image_xfer = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] filter_function = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance_api_insecure = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance_api_servers = ['http://192.168.122.76/image'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance_api_ssl_compression = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance_ca_certificates_file = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance_catalog_info = image:glance:publicURL {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance_certfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance_keyfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance_num_retries = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance_request_timeout = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] goodness_function = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] graceful_shutdown_timeout = 5 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] group_api_class = cinder.group.api.API {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] host = devstack {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] image_compress_on_upload = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] image_conversion_address_space_limit = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] image_conversion_cpu_limit = 60 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] image_conversion_disable = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] image_upload_use_cinder_backend = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] image_upload_use_internal_tenant = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] image_volume_cache_enabled = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] image_volume_cache_max_count = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] image_volume_cache_max_size_gb = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] init_host_max_objects_retrieval = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] instance_format = [instance: %(uuid)s] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] iscsi_target_flags = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] iscsi_write_cache = on {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] iser_helper = tgtadm {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] iser_ip_address = 192.168.122.76 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] iser_port = 3260 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] log_color = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] log_config_append = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] log_dir = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] log_file = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] log_options = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] log_rotate_interval = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] log_rotate_interval_type = days {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] log_rotation_type = none {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] max_age = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] max_logfile_count = 30 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] max_logfile_size_mb = 200 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] max_over_subscription_ratio = 20.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] message_reap_interval = 86400 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] message_ttl = 2592000 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] migration_create_volume_timeout_secs = 300 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] monkey_patch = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] monkey_patch_modules = [] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] my_ip = 192.168.122.76 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] no_snapshot_gb_quota = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] num_iser_scan_tries = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] num_shell_tries = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] num_volume_device_scan_tries = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] nvmeof_conn_info_version = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] nvmet_ns_id = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] nvmet_port_id = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] osapi_max_limit = 1000 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] osapi_volume_ext_list = [] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] osapi_volume_listen = 0.0.0.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] osapi_volume_listen_port = 8776 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] osapi_volume_use_ssl = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] osapi_volume_workers = 2 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] per_volume_size_limit = -1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] periodic_fuzzy_delay = 60 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] periodic_interval = 60 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] project_id_regex = [0-9a-f\-]+ {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] public_endpoint = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] publish_errors = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] quota_backup_gigabytes = 1000 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] quota_backups = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] quota_gigabytes = 1000 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] quota_groups = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] quota_snapshots = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] quota_volumes = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] rate_limit_burst = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] rate_limit_except_level = CRITICAL {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] rate_limit_interval = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] reinit_driver_count = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] replication_device = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] report_discard_supported = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] report_interval = 120 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] reservation_clean_interval = 86400 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] reservation_expire = 86400 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] reserved_image_namespaces = [] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] reserved_percentage = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] rpc_response_timeout = 120 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] run_external_periodic_tasks = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] scst_target_driver = iscsi {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] scst_target_iqn_name = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_down_time = 720 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] shell_completion = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] snapshot_name_template = snapshot-%s {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] snapshot_same_host = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] split_loggers = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] state_path = /opt/stack/data/cinder {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] storage_availability_zone = nova {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] storage_protocol = iSCSI {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] syslog_log_facility = LOG_USER {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] target_helper = lioadm {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] target_ip_address = 192.168.122.76 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] target_port = 3260 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] target_protocol = iscsi {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] target_secondary_ip_addresses = [] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] trace_flags = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] transfer_api_class = cinder.transfer.api.API {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] transport_url = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] until_refresh = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] use_chap_auth = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] use_default_quota_class = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] use_journal = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] use_json = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] use_multipath_for_image_xfer = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] use_stderr = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] use_syslog = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] verify_glance_signatures = enabled {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_api_class = cinder.volume.api.API {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_backend_name = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_clear = zero {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_clear_ionice = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_clear_size = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_copy_bps_limit = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_dd_blocksize = 1M {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_name_template = volume-%s {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_service_inithost_offload = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volume_usage_audit_period = month {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] zoning_mode = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_concurrency.disable_process_locking = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.admin_password = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.admin_token = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.admin_user = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.auth_admin_prefix = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.auth_port = 35357 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.auth_protocol = https {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.auth_section = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.auth_type = password {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.auth_uri = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.auth_version = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.cache = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.certfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.delay_auth_decision = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.http_connect_timeout = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.identity_uri = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.include_service_catalog = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.insecure = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.interface = public {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.keyfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_password = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcache_username = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.region_name = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.service_token_roles_required = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.service_type = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.token_cache_time = 300 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.76/identity {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.backend = dogpile.cache.null {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.backend_argument = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.backend_expiration_time = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.config_prefix = cache.oslo {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.debug_cache_backend = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.enable_retry_client = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.enable_socket_keepalive = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.enabled = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.enforce_fips_mode = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.expiration_time = 600 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.hashclient_retry_attempts = 2 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.memcache_dead_retry = 300 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.memcache_pool_maxsize = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.memcache_sasl_enabled = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.password = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.proxies = [] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.redis_db = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.redis_sentinel_service_name = mymaster {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.redis_server = localhost:6379 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.retry_attempts = 2 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.retry_delay = 0.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.socket_keepalive_count = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.socket_keepalive_idle = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.socket_keepalive_interval = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.socket_timeout = 1.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.tls_allowed_ciphers = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.tls_cafile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.tls_certfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.tls_enabled = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.tls_keyfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cache.username = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] coordination.backend_url = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.asyncio_connection = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.asyncio_slave_connection = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.backend = sqlalchemy {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.connection = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.connection_debug = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.connection_parameters = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.connection_recycle_time = 3600 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.connection_trace = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.db_inc_retry_interval = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.db_max_retries = 20 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.db_max_retry_interval = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.db_retry_interval = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.max_overflow = 50 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.max_pool_size = 5 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.max_retries = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.mysql_wsrep_sync_wait = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.pool_timeout = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.retry_interval = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.slave_connection = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.sqlite_synchronous = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.synchronous_reader = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] database.use_db_reconnect = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.connection_string = messaging:// {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.enabled = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.es_doc_type = notification {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.es_scroll_size = 10000 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.es_scroll_time = 2m {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.filter_error_trace = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.hmac_keys = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.sentinel_service_name = mymaster {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.socket_timeout = 0.1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.trace_requests = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler.trace_sqlalchemy = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler_jaeger.process_tags = {} {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler_jaeger.service_name_prefix = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] profiler_otlp.service_name_prefix = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.enforce_new_defaults = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: WARNING oslo_config.cfg [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.enforce_scope = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.policy_default_rule = default {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.policy_file = policy.yaml {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_policy.remote_timeout = 60.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] privsep_osbrick.group = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] privsep_osbrick.helper_command = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] privsep_osbrick.user = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cinder_sys_admin.group = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cinder_sys_admin.helper_command = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] cinder_sys_admin.user = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_user.auth_section = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_user.auth_type = password {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_user.cafile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_user.certfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_user.collect_timing = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_user.insecure = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_user.keyfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_user.send_service_user_token = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_user.split_loggers = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] service_user.timeout = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance.auth_section = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance.auth_type = password {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance.certfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance.collect_timing = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance.insecure = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance.keyfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance.region_name = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance.split_loggers = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] glance.timeout = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.backend_availability_zone = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.chap_password = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.chap_username = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.disk_geometry = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.driver_client_cert = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.driver_client_cert_key = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.driver_data_namespace = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.driver_use_ssl = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.enable_unsupported_driver = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.extra_capabilities = {} {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.filter_function = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.goodness_function = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.iscsi_target_flags = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.iscsi_write_cache = on {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.iser_helper = tgtadm {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.iser_ip_address = 192.168.122.76 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.iser_port = 3260 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72498]: INFO cinder.volume.manager [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.lvm_mirrors = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.lvm_share_target = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.lvm_type = auto {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.num_shell_tries = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.nvmet_port_id = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.replication_device = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.report_discard_supported = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.reserved_percentage = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.scst_target_driver = iscsi {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.scst_target_iqn_name = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.storage_protocol = iSCSI {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.target_helper = tgtadm {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.target_ip_address = 192.168.122.76 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.target_port = 3260 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.target_protocol = iscsi {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.trace_flags = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.unique_fqdn_network = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.use_chap_auth = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.volume_backend_name = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.volume_clear = zero {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.volume_clear_ionice = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.volume_clear_size = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.volume_group = cinder-volumes {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_reports.file_event_handler = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_reports.log_dir = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.backend_availability_zone = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.backend_host = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.chap_password = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.chap_username = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.chiscsi_conf = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.disk_geometry = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.driver_client_cert = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.driver_data_namespace = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.driver_use_ssl = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.extra_capabilities = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.filter_function = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.goodness_function = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.iser_helper = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.iser_ip_address = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.iser_port = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.iser_target_prefix = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.lvm_conf_file = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.lvm_mirrors = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.lvm_share_target = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.lvm_type = auto {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.num_shell_tries = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.nvmet_port_id = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.replication_device = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.report_discard_supported = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.reserved_percentage = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.scst_target_driver = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.storage_protocol = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.target_helper = lioadm {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.target_ip_address = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.target_port = 3260 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.target_protocol = iscsi {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.trace_flags = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.use_chap_auth = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.volume_clear = zero {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.volume_clear_size = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] lvmdriver-1.volumes_dir = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.ssl = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.ssl_version = {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_notifications.driver = [] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_notifications.retry = -1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] oslo_messaging_notifications.transport_url = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] key_manager.fixed_key = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.barbican_api_version = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.barbican_endpoint = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.barbican_endpoint_type = public {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.barbican_region_name = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.cafile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.certfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.collect_timing = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.insecure = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.keyfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.number_of_retries = 60 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.retry_delay = 1 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.send_service_user_token = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.split_loggers = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.timeout = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.verify_ssl = True {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican.verify_ssl_path = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican_service_user.auth_section = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican_service_user.auth_type = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican_service_user.cafile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican_service_user.certfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican_service_user.collect_timing = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican_service_user.insecure = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican_service_user.keyfile = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican_service_user.split_loggers = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] barbican_service_user.timeout = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.approle_role_id = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.approle_secret_id = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.kv_mountpoint = secret {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.kv_path = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.kv_version = 2 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.namespace = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.root_token_id = **** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.ssl_ca_crt_file = None {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.timeout = 60.0 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.use_ssl = False {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:27:40 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] ******************************************************************************** {{(pid=72396) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 10:27:40 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:40 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:40 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:40 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:40 devstack sudo[72502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 10 10:27:40 devstack sudo[72502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:41 devstack sudo[72502]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:41 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.558s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:41 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:41 devstack sudo[72532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:41 devstack sudo[72532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:41 devstack sudo[72532]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:41 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.561s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:41 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:27:41 devstack cinder-volume[72498]: INFO cinder.brick.local_dev.lvm [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 10 10:27:41 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:41 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:41 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:41 devstack sudo[72779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:41 devstack sudo[72779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:42 devstack sudo[72779]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:42 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.629s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:42 devstack cinder-volume[72498]: DEBUG cinder.brick.local_dev.lvm [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72498) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 10 10:27:42 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:42 devstack sudo[72991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:42 devstack sudo[72991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:43 devstack sudo[72991]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:43 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.035s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:43 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:43 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:43 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:43 devstack sudo[73176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:43 devstack sudo[73176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:43 devstack sudo[73176]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:43 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.477s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:43 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:43 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:43 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:43 devstack sudo[73191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 10 10:27:43 devstack sudo[73191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:44 devstack sudo[73191]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:44 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.499s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:44 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:44 devstack sudo[73197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:44 devstack sudo[73197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:44 devstack sudo[73197]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:44 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.477s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:44 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:44 devstack sudo[73202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:44 devstack sudo[73202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:45 devstack sudo[73202]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:45 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.499s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:45 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:45 devstack sudo[73205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:45 devstack sudo[73205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:45 devstack sudo[73205]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:45 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.489s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:45 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:45 devstack sudo[73210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:45 devstack sudo[73210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:46 devstack sudo[73210]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:46 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.497s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:46 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:46 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:46 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:46 devstack sudo[73217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:46 devstack sudo[73217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:46 devstack sudo[73217]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:46 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.530s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:46 devstack cinder-volume[72498]: INFO cinder.volume.drivers.lvm [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 10 10:27:46 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:46 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:46 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:46 devstack sudo[73227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:46 devstack sudo[73227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:47 devstack sudo[73227]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:47 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.547s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:47 devstack cinder-volume[72498]: DEBUG cinder.volume.drivers.lvm [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Updating volume stats {{(pid=72498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:27:47 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:47 devstack sudo[73345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:47 devstack sudo[73345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:47 devstack sudo[73345]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:47 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:47 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:47 devstack sudo[73483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:47 devstack sudo[73483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:48 devstack sudo[73483]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:48 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.527s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:48 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:48 devstack sudo[73490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:48 devstack sudo[73490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:48 devstack sudo[73490]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:48 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.479s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:48 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:48 devstack sudo[73493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:48 devstack sudo[73493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:49 devstack sudo[73493]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:49 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.483s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:49 devstack cinder-volume[72498]: INFO cinder.volume.driver [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Driver hasn't implemented _init_vendor_properties() Apr 10 10:27:49 devstack cinder-volume[72498]: DEBUG cinder.volume.driver [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72498) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 10:27:49 devstack cinder-volume[72498]: DEBUG oslo_db.sqlalchemy.engines [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72498) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:27:49 devstack cinder-volume[72498]: DEBUG dbcounter [-] [72498] Writer thread running {{(pid=72498) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:27:49 devstack cinder-volume[72498]: DEBUG cinder.db.sqlalchemy.api [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Building query based on filter {{(pid=72498) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 10:27:49 devstack cinder-volume[72498]: DEBUG cinder.image.image_utils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72498) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 10:27:49 devstack cinder-volume[72498]: INFO cinder.keymgr.migration [None req-23105e28-b7f9-4bd1-9eee-cee25ecd700a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 10:27:49 devstack cinder-volume[72498]: DEBUG cinder.volume.drivers.lvm [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Updating volume stats {{(pid=72498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:27:49 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:49 devstack sudo[73497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:49 devstack sudo[73497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:50 devstack sudo[73497]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:50 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.514s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:50 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:50 devstack sudo[73501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:50 devstack sudo[73501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:50 devstack cinder-volume[72396]: DEBUG dbcounter [-] [72396] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72396) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:27:50 devstack sudo[73501]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:50 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:50 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:50 devstack sudo[73509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:50 devstack sudo[73509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:51 devstack sudo[73509]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:51 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.534s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:51 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:51 devstack sudo[73513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:51 devstack sudo[73513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:51 devstack sudo[73513]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:51 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.513s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:51 devstack cinder-volume[72498]: DEBUG cinder.manager [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Notifying Schedulers of capabilities ... {{(pid=72498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:27:51 devstack cinder-volume[72498]: INFO cinder.volume.manager [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Driver initialization completed successfully. Apr 10 10:27:51 devstack cinder-volume[72498]: INFO cinder.manager [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Initiating service 2 cleanup Apr 10 10:27:51 devstack cinder-volume[72498]: INFO cinder.manager [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Service 2 cleanup completed. Apr 10 10:27:51 devstack cinder-volume[72498]: DEBUG cinder.service [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Creating RPC server for service cinder-volume {{(pid=72498) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 10:27:51 devstack cinder-volume[72498]: DEBUG cinder.service [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72498) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 10:27:51 devstack cinder-volume[72498]: INFO cinder.volume.manager [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 10 10:27:51 devstack cinder-volume[72498]: DEBUG cinder.volume.drivers.lvm [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Updating volume stats {{(pid=72498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:27:51 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:51 devstack sudo[73518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:27:51 devstack sudo[73518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:52 devstack sudo[73518]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:52 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.548s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:52 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:52 devstack sudo[73556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:52 devstack sudo[73556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:52 devstack sudo[73556]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:52 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:52 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:52 devstack sudo[73581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:27:52 devstack sudo[73581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:53 devstack sudo[73581]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:53 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.470s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:53 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:27:53 devstack sudo[73584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:27:53 devstack sudo[73584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:27:53 devstack sudo[73584]: pam_unix(sudo:session): session closed for user root Apr 10 10:27:53 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.446s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:27:53 devstack cinder-volume[72498]: INFO cinder.volume.manager [None req-e7458338-dc27-43fe-9c7d-9ea698c6614d None None] Driver post RPC initialization completed successfully. Apr 10 10:28:01 devstack cinder-volume[72498]: DEBUG dbcounter [-] [72498] Writing DB stats cinder:SELECT=3 {{(pid=72498) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:28:03 devstack cinder-volume[72498]: DEBUG dbcounter [-] [72498] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72498) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:29:31 devstack cinder-volume[72498]: DEBUG oslo_service.periodic_task [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72498) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:29:31 devstack cinder-volume[72498]: DEBUG cinder.volume.drivers.lvm [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Updating volume stats {{(pid=72498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:29:31 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:31 devstack sudo[78606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:29:31 devstack sudo[78606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:32 devstack sudo[78606]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:32 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.468s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:32 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:32 devstack sudo[78610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:29:32 devstack sudo[78610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:32 devstack sudo[78610]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:32 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:32 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:32 devstack sudo[78613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:29:32 devstack sudo[78613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:33 devstack sudo[78613]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:33 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.476s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:33 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:29:33 devstack sudo[78616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:29:33 devstack sudo[78616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:29:33 devstack sudo[78616]: pam_unix(sudo:session): session closed for user root Apr 10 10:29:33 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.487s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:29:33 devstack cinder-volume[72498]: DEBUG cinder.manager [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Notifying Schedulers of capabilities ... {{(pid=72498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:30:03 devstack cinder-volume[72498]: DEBUG dbcounter [-] [72498] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=72498) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:30:31 devstack cinder-volume[72498]: DEBUG oslo_service.periodic_task [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72498) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:30:31 devstack cinder-volume[72498]: DEBUG cinder.volume.drivers.lvm [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Updating volume stats {{(pid=72498) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 10:30:31 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:31 devstack sudo[80520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 10:30:31 devstack sudo[80520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:32 devstack sudo[80520]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:32 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.560s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:32 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:32 devstack sudo[80530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:30:32 devstack sudo[80530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:32 devstack sudo[80530]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:32 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:32 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:32 devstack sudo[80533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 10:30:32 devstack sudo[80533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:33 devstack sudo[80533]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:33 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.487s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:33 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:30:33 devstack sudo[80537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 10:30:33 devstack sudo[80537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:30:33 devstack sudo[80537]: pam_unix(sudo:session): session closed for user root Apr 10 10:30:33 devstack cinder-volume[72498]: DEBUG oslo_concurrency.processutils [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=72498) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:30:33 devstack cinder-volume[72498]: DEBUG cinder.manager [None req-4420904c-7b3b-4d28-9813-4d03b3d9bae6 None None] Notifying Schedulers of capabilities ... {{(pid=72498) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:31:24 devstack cinder-volume[72396]: INFO oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Caught SIGTERM, stopping children Apr 10 10:31:24 devstack cinder-volume[72396]: DEBUG oslo_concurrency.lockutils [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Acquiring lock "singleton_lock" {{(pid=72396) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:31:24 devstack cinder-volume[72396]: DEBUG oslo_concurrency.lockutils [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Acquired lock "singleton_lock" {{(pid=72396) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:31:24 devstack cinder-volume[72396]: DEBUG oslo_concurrency.lockutils [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Releasing lock "singleton_lock" {{(pid=72396) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:31:24 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Stop services. {{(pid=72396) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 10:31:24 devstack cinder-volume[72396]: DEBUG oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Killing children. {{(pid=72396) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 10:31:24 devstack cinder-volume[72396]: INFO oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Waiting on 1 children to exit Apr 10 10:31:26 devstack cinder-volume[72498]: DEBUG oslo_concurrency.lockutils [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Acquiring lock "singleton_lock" {{(pid=72498) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:31:26 devstack cinder-volume[72498]: DEBUG oslo_concurrency.lockutils [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Acquired lock "singleton_lock" {{(pid=72498) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:31:26 devstack cinder-volume[72498]: DEBUG oslo_concurrency.lockutils [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Releasing lock "singleton_lock" {{(pid=72498) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:31:26 devstack cinder-volume[72498]: WARNING amqp [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:31:26 devstack cinder-volume[72498]: WARNING amqp [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:31:26 devstack cinder-volume[72396]: INFO oslo_service.backend._eventlet.service [None req-f37923a3-5a22-4eb2-b1fb-72750877129a None None] Child 72498 exited with status 0 Apr 10 10:31:26 devstack cinder-volume[81563]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 10:31:26 devstack cinder-volume[81563]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:31:26 devstack cinder-volume[81563]: we strongly recommend against using it for new projects. Apr 10 10:31:26 devstack cinder-volume[81563]: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:31:26 devstack cinder-volume[81563]: framework. For more detail see Apr 10 10:31:26 devstack cinder-volume[81563]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:31:26 devstack cinder-volume[81563]: import eventlet # noqa Apr 10 10:31:29 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:31:29 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:31:29 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:31:29 devstack cinder-volume[81563]: INFO dbcounter [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Registered counter for database cinder Apr 10 10:31:29 devstack cinder-volume[81563]: DEBUG oslo_db.sqlalchemy.engines [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG dbcounter [-] [81563] Writer thread running {{(pid=81563) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:31:30 devstack cinder-volume[81563]: INFO cinder.rpc [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 10:31:30 devstack cinder-volume[81563]: INFO cinder.rpc [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_db.sqlalchemy.engines [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:31:30 devstack cinder-volume[81563]: INFO cinder.volume.manager [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Determined volume DB was empty at startup. Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG cinder.volume.manager [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81563) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 10:31:30 devstack cinder-volume[81563]: INFO cinder.volume.manager [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 10:31:30 devstack cinder-volume[81563]: WARNING stevedore.named [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:31:30 devstack cinder-volume[81563]: WARNING castellan.key_manager [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:31:30 devstack cinder-volume[81563]: WARNING cinder.keymgr.conf_key_mgr [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:31:30 devstack cinder-volume[81563]: INFO cinder.volume.manager [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_db.sqlalchemy.engines [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81563) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:31:30 devstack cinder-volume[81563]: INFO oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Starting 1 workers Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Started child 81682 {{(pid=81563) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Full set of CONF: {{(pid=81563) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] ******************************************************************************** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Configuration options gathered from: {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] ================================================================================ {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] allow_availability_zone_fallback = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] allow_compression_on_image_upload = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] allowed_direct_url_schemes = [] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] api_rate_limit = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81682]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] auth_strategy = keystone {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_availability_zone = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_host = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_name = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_stats_polling_interval = 60 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backup_api_class = cinder.backup.api.API {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backup_name_template = backup-%s {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backup_use_same_host = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backup_use_temp_snapshot = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] chap_password = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] chap_username = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cinder_internal_tenant_project_id = 5e4209c292f548a6a4500979f21299e4 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cinder_internal_tenant_user_id = c9c38effb0504b1d93cd9b0f079893a4 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cluster = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] compression_format = gzip {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] compute_api_class = cinder.compute.nova.API {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] config_dir = [] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] config_source = [] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] control_exchange = openstack {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] debug = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] default_availability_zone = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] default_group_type = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] default_volume_type = QuobyteHD {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] disk_geometry = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] driver_client_cert = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] driver_client_cert_key = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] driver_data_namespace = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] driver_ssl_cert_path = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] driver_ssl_cert_verify = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] driver_use_ssl = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] enable_new_services = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] enable_unsupported_driver = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] enabled_backends = ['QuobyteHD'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] enforce_multipath_for_image_xfer = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] filter_function = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance_api_insecure = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance_api_servers = ['http://192.168.122.76/image'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance_api_ssl_compression = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance_ca_certificates_file = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance_catalog_info = image:glance:publicURL {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance_certfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance_keyfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance_num_retries = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance_request_timeout = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] goodness_function = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] graceful_shutdown_timeout = 5 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] group_api_class = cinder.group.api.API {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] host = devstack {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] image_compress_on_upload = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] image_conversion_address_space_limit = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] image_conversion_cpu_limit = 60 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] image_conversion_disable = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] image_upload_use_cinder_backend = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] image_upload_use_internal_tenant = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] image_volume_cache_enabled = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] image_volume_cache_max_count = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] image_volume_cache_max_size_gb = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] init_host_max_objects_retrieval = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] instance_format = [instance: %(uuid)s] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] iscsi_target_flags = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] iscsi_write_cache = on {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] iser_helper = tgtadm {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] iser_ip_address = 192.168.122.76 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] iser_port = 3260 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] log_color = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] log_config_append = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] log_dir = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] log_file = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] log_options = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] log_rotate_interval = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] log_rotate_interval_type = days {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] log_rotation_type = none {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] max_age = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] max_logfile_count = 30 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] max_logfile_size_mb = 200 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] max_over_subscription_ratio = 20.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] message_reap_interval = 86400 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] message_ttl = 2592000 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] migration_create_volume_timeout_secs = 300 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] monkey_patch = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] monkey_patch_modules = [] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] my_ip = 192.168.122.76 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] no_snapshot_gb_quota = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] num_iser_scan_tries = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] num_shell_tries = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] num_volume_device_scan_tries = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] nvmeof_conn_info_version = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] nvmet_ns_id = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] nvmet_port_id = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] osapi_max_limit = 1000 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] osapi_volume_ext_list = [] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] osapi_volume_listen = 0.0.0.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] osapi_volume_listen_port = 8776 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] osapi_volume_use_ssl = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] osapi_volume_workers = 2 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] per_volume_size_limit = -1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] periodic_fuzzy_delay = 60 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] periodic_interval = 60 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] project_id_regex = [0-9a-f\-]+ {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] public_endpoint = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] publish_errors = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] quota_backup_gigabytes = 1000 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] quota_backups = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] quota_gigabytes = 1000 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] quota_groups = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] quota_snapshots = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] quota_volumes = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] rate_limit_burst = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] rate_limit_except_level = CRITICAL {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] rate_limit_interval = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] reinit_driver_count = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] replication_device = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] report_discard_supported = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] report_interval = 120 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] reservation_clean_interval = 86400 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] reservation_expire = 86400 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] reserved_image_namespaces = [] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] reserved_percentage = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] rpc_response_timeout = 120 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] run_external_periodic_tasks = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] scst_target_driver = iscsi {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] scst_target_iqn_name = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_down_time = 720 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] shell_completion = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] snapshot_name_template = snapshot-%s {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] split_loggers = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] state_path = /opt/stack/data/cinder {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81682]: INFO cinder.volume.manager [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] storage_availability_zone = nova {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] storage_protocol = iSCSI {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] syslog_log_facility = LOG_USER {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] target_helper = lioadm {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] target_ip_address = 192.168.122.76 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] target_port = 3260 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] target_protocol = iscsi {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] target_secondary_ip_addresses = [] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] trace_flags = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] transfer_api_class = cinder.transfer.api.API {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] transport_url = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] until_refresh = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] use_chap_auth = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] use_default_quota_class = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] use_journal = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] use_json = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81682]: DEBUG cinder.volume.drivers.remotefs [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=81682) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] use_multipath_for_image_xfer = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] use_stderr = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] use_syslog = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] verify_glance_signatures = enabled {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_api_class = cinder.volume.api.API {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_backend_name = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_clear = zero {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_clear_ionice = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_clear_size = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_copy_bps_limit = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_dd_blocksize = 1M {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_name_template = volume-%s {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_service_inithost_offload = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volume_usage_audit_period = month {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] zoning_mode = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_concurrency.disable_process_locking = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.admin_password = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.admin_token = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.admin_user = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.auth_admin_prefix = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.auth_port = 35357 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.auth_protocol = https {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.auth_section = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.auth_type = password {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.auth_uri = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.auth_version = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.cache = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.certfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.delay_auth_decision = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.http_connect_timeout = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.identity_uri = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.include_service_catalog = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.insecure = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.interface = public {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.keyfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_password = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcache_username = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.region_name = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.service_token_roles_required = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.service_type = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.token_cache_time = 300 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.76/identity {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.backend = dogpile.cache.null {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.backend_argument = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.backend_expiration_time = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.config_prefix = cache.oslo {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.debug_cache_backend = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.enable_retry_client = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.enable_socket_keepalive = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.enabled = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.enforce_fips_mode = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.expiration_time = 600 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.hashclient_retry_attempts = 2 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.memcache_dead_retry = 300 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.memcache_pool_maxsize = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.memcache_sasl_enabled = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.password = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.proxies = [] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.redis_db = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.redis_sentinel_service_name = mymaster {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.redis_server = localhost:6379 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.retry_attempts = 2 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.retry_delay = 0.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.socket_keepalive_count = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.socket_keepalive_idle = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.socket_keepalive_interval = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.socket_timeout = 1.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.tls_allowed_ciphers = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.tls_cafile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.tls_certfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.tls_enabled = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.tls_keyfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cache.username = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] coordination.backend_url = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.asyncio_connection = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.asyncio_slave_connection = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.backend = sqlalchemy {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.connection = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.connection_debug = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.connection_parameters = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.connection_recycle_time = 3600 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.connection_trace = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.db_inc_retry_interval = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.db_max_retries = 20 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.db_max_retry_interval = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.db_retry_interval = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.max_overflow = 50 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.max_pool_size = 5 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.max_retries = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.mysql_wsrep_sync_wait = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.pool_timeout = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.retry_interval = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.slave_connection = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.sqlite_synchronous = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.synchronous_reader = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] database.use_db_reconnect = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.connection_string = messaging:// {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.enabled = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.es_doc_type = notification {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.es_scroll_size = 10000 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.es_scroll_time = 2m {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.filter_error_trace = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.hmac_keys = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.sentinel_service_name = mymaster {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.socket_timeout = 0.1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.trace_requests = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler.trace_sqlalchemy = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler_jaeger.process_tags = {} {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler_jaeger.service_name_prefix = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] profiler_otlp.service_name_prefix = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.enforce_new_defaults = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: WARNING oslo_config.cfg [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.enforce_scope = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.policy_default_rule = default {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.policy_file = policy.yaml {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_policy.remote_timeout = 60.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] privsep_osbrick.group = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] privsep_osbrick.helper_command = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] privsep_osbrick.user = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cinder_sys_admin.group = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cinder_sys_admin.helper_command = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] cinder_sys_admin.user = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_user.auth_section = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_user.auth_type = password {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_user.cafile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_user.certfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_user.collect_timing = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_user.insecure = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_user.keyfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_user.send_service_user_token = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_user.split_loggers = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] service_user.timeout = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance.auth_section = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance.auth_type = password {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance.certfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance.collect_timing = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance.insecure = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance.keyfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance.region_name = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance.split_loggers = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] glance.timeout = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.backend_availability_zone = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.chap_password = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.chap_username = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.disk_geometry = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.driver_client_cert = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.driver_client_cert_key = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.driver_data_namespace = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.driver_use_ssl = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.enable_unsupported_driver = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.extra_capabilities = {} {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.filter_function = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.goodness_function = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.iscsi_target_flags = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.iscsi_write_cache = on {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.iser_helper = tgtadm {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.iser_ip_address = 192.168.122.76 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.iser_port = 3260 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nas_host = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nas_login = admin {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nas_mount_options = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nas_password = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nas_private_key = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nas_share_path = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nas_ssh_port = 22 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.num_shell_tries = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.nvmet_port_id = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.quobyte_client_cfg = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.quobyte_volume_url = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.replication_device = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.report_discard_supported = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.reserved_percentage = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.scst_target_driver = iscsi {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.scst_target_iqn_name = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.storage_protocol = iSCSI {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.target_helper = tgtadm {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.target_ip_address = 192.168.122.76 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.target_port = 3260 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.target_protocol = iscsi {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81682]: DEBUG cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=81682) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.trace_flags = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81682]: WARNING cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.unique_fqdn_network = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81682]: WARNING cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.use_chap_auth = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.volume_backend_name = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.volume_clear = zero {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.volume_clear_ionice = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.volume_clear_size = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Running cmd (subprocess): mount.quobyte {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_reports.file_event_handler = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_reports.log_dir = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.backend_availability_zone = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.backend_host = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.chap_password = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.chap_username = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.chiscsi_conf = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.disk_geometry = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.driver_client_cert = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.driver_client_cert_key = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.driver_data_namespace = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.driver_use_ssl = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.extra_capabilities = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.filter_function = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.goodness_function = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.iscsi_target_flags = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.iscsi_write_cache = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.iser_helper = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.iser_ip_address = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.iser_port = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.iser_target_prefix = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nas_host = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nas_login = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nas_mount_options = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nas_password = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nas_private_key = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nas_share_path = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nas_ssh_port = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.num_shell_tries = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nvmet_ns_id = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.nvmet_port_id = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.replication_device = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.report_discard_supported = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.reserved_percentage = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.scst_target_driver = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.storage_protocol = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.target_helper = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.target_ip_address = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.target_port = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.target_prefix = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.target_protocol = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.trace_flags = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.unique_fqdn_network = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.use_chap_auth = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.volume_clear = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.volume_clear_ionice = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.volume_clear_size = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] QuobyteHD.volumes_dir = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.ssl = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.ssl_version = {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_notifications.driver = [] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_notifications.retry = -1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] oslo_messaging_notifications.transport_url = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] key_manager.fixed_key = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.barbican_api_version = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.barbican_endpoint = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.barbican_endpoint_type = public {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.barbican_region_name = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.cafile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.certfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.collect_timing = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.insecure = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.keyfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.number_of_retries = 60 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.retry_delay = 1 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.send_service_user_token = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.split_loggers = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.timeout = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.verify_ssl = True {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican.verify_ssl_path = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican_service_user.auth_section = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican_service_user.auth_type = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican_service_user.cafile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican_service_user.certfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican_service_user.collect_timing = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican_service_user.insecure = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican_service_user.keyfile = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican_service_user.split_loggers = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] barbican_service_user.timeout = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.approle_role_id = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.approle_secret_id = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.kv_mountpoint = secret {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.kv_path = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.kv_version = 2 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.namespace = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.root_token_id = **** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.ssl_ca_crt_file = None {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.timeout = 60.0 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.use_ssl = False {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:30 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] ******************************************************************************** {{(pid=81563) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 10:31:30 devstack quobyte-client[81683]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 10:31:30 devstack quobyte-client[81683]: Invalid parameters found, error: missing mount point. Apr 10 10:31:30 devstack quobyte-client[81683]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 10:31:30 devstack quobyte-client[81683]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 10:31:30 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] CMD "mount.quobyte" returned: 1 in 0.090s {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:30 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:30 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:30 devstack cinder-volume[81682]: DEBUG cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=81682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:30 devstack cinder-volume[81682]: INFO cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e ... Apr 10 10:31:30 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 -c /etc/quobyte/client-cinder.cfg {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:30 devstack sudo[81684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 -c /etc/quobyte/client-cinder.cfg Apr 10 10:31:30 devstack sudo[81684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:31 devstack sudo[81684]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.595s {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:31 devstack cinder-volume[81682]: INFO cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e succeeded Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=81682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.605s {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:31 devstack sudo[81753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:31:31 devstack sudo[81753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:31 devstack sudo[81753]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.430s {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:31 devstack cinder-volume[81682]: INFO cinder.volume.driver [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG cinder.volume.driver [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=81682) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG oslo_db.sqlalchemy.engines [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG dbcounter [-] [81682] Writer thread running {{(pid=81682) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG cinder.db.sqlalchemy.api [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Building query based on filter {{(pid=81682) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG cinder.image.image_utils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=81682) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 10:31:31 devstack cinder-volume[81682]: INFO cinder.keymgr.migration [None req-ace3f8b3-4103-48bf-be46-e11427776d27 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=81682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=81682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:31 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:31 devstack sudo[81757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:31:31 devstack sudo[81757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:32 devstack sudo[81757]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.485s {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG cinder.manager [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Notifying Schedulers of capabilities ... {{(pid=81682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:31:32 devstack cinder-volume[81682]: INFO cinder.volume.manager [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Driver initialization completed successfully. Apr 10 10:31:32 devstack cinder-volume[81682]: INFO cinder.manager [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Initiating service 3 cleanup Apr 10 10:31:32 devstack cinder-volume[81682]: INFO cinder.manager [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Service 3 cleanup completed. Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG cinder.service [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Creating RPC server for service cinder-volume {{(pid=81682) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG cinder.service [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=81682) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 10:31:32 devstack cinder-volume[81682]: INFO cinder.volume.manager [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=81682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG cinder.volume.drivers.quobyte [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=81682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:32 devstack sudo[81765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:31:32 devstack sudo[81765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:32 devstack sudo[81765]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:32 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.474s {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:32 devstack cinder-volume[81682]: INFO cinder.volume.manager [None req-37220660-cd58-44c5-81e9-7357663dbb66 None None] Driver post RPC initialization completed successfully. Apr 10 10:31:36 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-32891fce-7362-4462-bfb8-f11a4d8e84a6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:36 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-32891fce-7362-4462-bfb8-f11a4d8e84a6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:36 devstack cinder-volume[81682]: DEBUG cinder.volume.drivers.quobyte [None req-32891fce-7362-4462-bfb8-f11a4d8e84a6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=81682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:36 devstack cinder-volume[81682]: DEBUG cinder.volume.drivers.quobyte [None req-32891fce-7362-4462-bfb8-f11a4d8e84a6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=81682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:36 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-32891fce-7362-4462-bfb8-f11a4d8e84a6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=81682) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:36 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-32891fce-7362-4462-bfb8-f11a4d8e84a6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:36 devstack sudo[81828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:31:36 devstack sudo[81828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:36 devstack sudo[81828]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:36 devstack cinder-volume[81682]: DEBUG oslo_concurrency.processutils [None req-32891fce-7362-4462-bfb8-f11a4d8e84a6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.445s {{(pid=81682) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:36 devstack cinder-volume[81682]: DEBUG cinder.manager [None req-32891fce-7362-4462-bfb8-f11a4d8e84a6 None None] Notifying Schedulers of capabilities ... {{(pid=81682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:31:38 devstack cinder-volume[81563]: INFO oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Caught SIGTERM, stopping children Apr 10 10:31:38 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Acquiring lock "singleton_lock" {{(pid=81563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:31:38 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Acquired lock "singleton_lock" {{(pid=81563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:31:38 devstack cinder-volume[81563]: DEBUG oslo_concurrency.lockutils [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Releasing lock "singleton_lock" {{(pid=81563) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:31:38 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Stop services. {{(pid=81563) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 10:31:38 devstack cinder-volume[81563]: DEBUG oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Killing children. {{(pid=81563) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 10:31:38 devstack cinder-volume[81563]: INFO oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Waiting on 1 children to exit Apr 10 10:31:40 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Acquiring lock "singleton_lock" {{(pid=81682) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:31:40 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Acquired lock "singleton_lock" {{(pid=81682) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:31:40 devstack cinder-volume[81682]: DEBUG oslo_concurrency.lockutils [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Releasing lock "singleton_lock" {{(pid=81682) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:31:40 devstack cinder-volume[81682]: WARNING amqp [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:31:40 devstack cinder-volume[81682]: WARNING amqp [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 10:31:40 devstack cinder-volume[81563]: INFO oslo_service.backend._eventlet.service [None req-50fe7ca6-fa0e-4697-b0d7-859e618bf40f None None] Child 81682 exited with status 0 Apr 10 10:31:40 devstack cinder-volume[81901]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 10:31:40 devstack cinder-volume[81901]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:31:40 devstack cinder-volume[81901]: we strongly recommend against using it for new projects. Apr 10 10:31:40 devstack cinder-volume[81901]: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:31:40 devstack cinder-volume[81901]: framework. For more detail see Apr 10 10:31:40 devstack cinder-volume[81901]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:31:40 devstack cinder-volume[81901]: import eventlet # noqa Apr 10 10:31:42 devstack cinder-volume[81901]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=81901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 10:31:42 devstack cinder-volume[81901]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=81901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 10:31:42 devstack cinder-volume[81901]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=81901) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 10:31:43 devstack cinder-volume[81901]: INFO dbcounter [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Registered counter for database cinder Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_db.sqlalchemy.engines [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81901) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG dbcounter [-] [81901] Writer thread running {{(pid=81901) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:31:43 devstack cinder-volume[81901]: INFO cinder.rpc [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 10:31:43 devstack cinder-volume[81901]: INFO cinder.rpc [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_db.sqlalchemy.engines [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81901) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:31:43 devstack cinder-volume[81901]: INFO cinder.volume.manager [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Determined volume DB was empty at startup. Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG cinder.volume.manager [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=81901) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 10:31:43 devstack cinder-volume[81901]: WARNING stevedore.named [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 10:31:43 devstack cinder-volume[81901]: WARNING castellan.key_manager [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:31:43 devstack cinder-volume[81901]: WARNING cinder.keymgr.conf_key_mgr [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 10:31:43 devstack cinder-volume[81901]: INFO cinder.volume.manager [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_db.sqlalchemy.engines [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81901) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:31:43 devstack cinder-volume[81901]: INFO oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Starting 1 workers Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Started child 82038 {{(pid=81901) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Full set of CONF: {{(pid=81901) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] ******************************************************************************** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Configuration options gathered from: {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] ================================================================================ {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] allow_availability_zone_fallback = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] allow_compression_on_image_upload = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] allowed_direct_url_schemes = [] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] api_rate_limit = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] auth_strategy = keystone {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_availability_zone = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_host = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_name = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_stats_polling_interval = 60 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backup_api_class = cinder.backup.api.API {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backup_name_template = backup-%s {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backup_use_same_host = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backup_use_temp_snapshot = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] chap_password = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] chap_username = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cinder_internal_tenant_project_id = 5e4209c292f548a6a4500979f21299e4 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cinder_internal_tenant_user_id = c9c38effb0504b1d93cd9b0f079893a4 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cluster = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] compression_format = gzip {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] compute_api_class = cinder.compute.nova.API {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] config_dir = [] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] config_source = [] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] control_exchange = openstack {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] debug = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] default_availability_zone = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[82038]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] default_group_type = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] default_volume_type = QuobyteHD {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] disk_geometry = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] driver_client_cert = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] driver_client_cert_key = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] driver_data_namespace = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] driver_ssl_cert_path = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] driver_ssl_cert_verify = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] driver_use_ssl = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] enable_new_services = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] enable_unsupported_driver = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] enabled_backends = ['QuobyteHD'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] enforce_multipath_for_image_xfer = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] filter_function = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance_api_insecure = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance_api_servers = ['http://192.168.122.76/image'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance_api_ssl_compression = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance_ca_certificates_file = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance_catalog_info = image:glance:publicURL {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance_certfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance_keyfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance_num_retries = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:43 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance_request_timeout = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] goodness_function = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] graceful_shutdown_timeout = 5 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] group_api_class = cinder.group.api.API {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] host = devstack {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] image_compress_on_upload = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] image_conversion_address_space_limit = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] image_conversion_cpu_limit = 60 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] image_conversion_disable = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] image_upload_use_cinder_backend = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] image_upload_use_internal_tenant = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] image_volume_cache_enabled = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] image_volume_cache_max_count = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] image_volume_cache_max_size_gb = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] init_host_max_objects_retrieval = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] instance_format = [instance: %(uuid)s] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] iscsi_target_flags = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] iscsi_write_cache = on {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] iser_helper = tgtadm {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] iser_ip_address = 192.168.122.76 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] iser_port = 3260 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] log_color = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] log_config_append = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] log_dir = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] log_file = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] log_options = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] log_rotate_interval = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] log_rotate_interval_type = days {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] log_rotation_type = none {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] max_age = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] max_logfile_count = 30 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] max_logfile_size_mb = 200 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] max_over_subscription_ratio = 20.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] message_reap_interval = 86400 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] message_ttl = 2592000 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] migration_create_volume_timeout_secs = 300 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] monkey_patch = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82038) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] monkey_patch_modules = [] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] my_ip = 192.168.122.76 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] no_snapshot_gb_quota = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] num_iser_scan_tries = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] num_shell_tries = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] num_volume_device_scan_tries = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] nvmeof_conn_info_version = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] nvmet_ns_id = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] nvmet_port_id = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] osapi_max_limit = 1000 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] osapi_volume_ext_list = [] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] osapi_volume_listen_port = 8776 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] osapi_volume_use_ssl = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] osapi_volume_workers = 2 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] per_volume_size_limit = -1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] periodic_fuzzy_delay = 60 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] periodic_interval = 60 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] public_endpoint = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] publish_errors = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] quota_backup_gigabytes = 1000 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] quota_backups = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] quota_gigabytes = 1000 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] quota_groups = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] quota_snapshots = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] quota_volumes = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] rate_limit_burst = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] rate_limit_except_level = CRITICAL {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] rate_limit_interval = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] reinit_driver_count = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] replication_device = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] report_discard_supported = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] report_interval = 120 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] reservation_clean_interval = 86400 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] reservation_expire = 86400 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] reserved_image_namespaces = [] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] reserved_percentage = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] rpc_response_timeout = 120 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] run_external_periodic_tasks = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] scst_target_driver = iscsi {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] scst_target_iqn_name = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_down_time = 720 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] shell_completion = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] snapshot_name_template = snapshot-%s {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] split_loggers = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] state_path = /opt/stack/data/cinder {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] storage_availability_zone = nova {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] storage_protocol = iSCSI {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] syslog_log_facility = LOG_USER {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] target_helper = lioadm {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] target_ip_address = 192.168.122.76 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] target_port = 3260 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] target_protocol = iscsi {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] target_secondary_ip_addresses = [] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] trace_flags = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] transport_url = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] until_refresh = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] use_chap_auth = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] use_default_quota_class = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] use_journal = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] use_json = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] use_multipath_for_image_xfer = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] use_stderr = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] use_syslog = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] verify_glance_signatures = enabled {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_api_class = cinder.volume.api.API {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_backend_name = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_clear = zero {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_clear_ionice = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_clear_size = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_copy_bps_limit = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_dd_blocksize = 1M {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_name_template = volume-%s {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_service_inithost_offload = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volume_usage_audit_period = month {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] zoning_mode = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_concurrency.disable_process_locking = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.admin_password = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.admin_token = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.admin_user = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.auth_admin_prefix = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.auth_port = 35357 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.auth_protocol = https {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.auth_section = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.auth_type = password {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.auth_uri = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.auth_version = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.cache = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.certfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.identity_uri = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.include_service_catalog = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.insecure = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.interface = public {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.keyfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_password = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcache_username = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.region_name = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.service_token_roles_required = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.service_type = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.76/identity {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.backend = dogpile.cache.null {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.backend_argument = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.backend_expiration_time = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.config_prefix = cache.oslo {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.debug_cache_backend = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.enable_retry_client = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.enable_socket_keepalive = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.enabled = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82038) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 10:31:44 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.quobyte [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 10:31:44 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.quobyte [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Running cmd (subprocess): mount.quobyte {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.enforce_fips_mode = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.expiration_time = 600 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.hashclient_retry_attempts = 2 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.memcache_dead_retry = 300 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.memcache_pool_maxsize = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.memcache_sasl_enabled = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.password = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.proxies = [] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.redis_db = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.redis_server = localhost:6379 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.retry_attempts = 2 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.retry_delay = 0.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.socket_keepalive_count = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.socket_keepalive_idle = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.socket_keepalive_interval = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.socket_timeout = 1.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.tls_allowed_ciphers = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.tls_cafile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.tls_certfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.tls_enabled = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.tls_keyfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cache.username = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] coordination.backend_url = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.asyncio_connection = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.asyncio_slave_connection = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.backend = sqlalchemy {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.connection = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.connection_debug = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.connection_parameters = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.connection_recycle_time = 3600 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.connection_trace = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.db_inc_retry_interval = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.db_max_retries = 20 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.db_max_retry_interval = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.db_retry_interval = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.max_overflow = 50 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.max_pool_size = 5 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.max_retries = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.mysql_wsrep_sync_wait = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.pool_timeout = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.retry_interval = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.slave_connection = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.sqlite_synchronous = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.synchronous_reader = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] database.use_db_reconnect = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.connection_string = messaging:// {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.enabled = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.es_doc_type = notification {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.es_scroll_size = 10000 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.es_scroll_time = 2m {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.filter_error_trace = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.hmac_keys = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.sentinel_service_name = mymaster {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.socket_timeout = 0.1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.trace_requests = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler.trace_sqlalchemy = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler_jaeger.process_tags = {} {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler_jaeger.service_name_prefix = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] profiler_otlp.service_name_prefix = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.enforce_new_defaults = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: WARNING oslo_config.cfg [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.enforce_scope = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.policy_default_rule = default {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.policy_file = policy.yaml {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] privsep_osbrick.group = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] privsep_osbrick.helper_command = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] privsep_osbrick.user = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cinder_sys_admin.group = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cinder_sys_admin.helper_command = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] cinder_sys_admin.user = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_user.auth_section = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_user.auth_type = password {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_user.cafile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_user.certfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_user.collect_timing = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_user.insecure = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_user.keyfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_user.send_service_user_token = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_user.split_loggers = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] service_user.timeout = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance.auth_section = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance.auth_type = password {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance.certfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance.collect_timing = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance.insecure = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance.keyfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance.region_name = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance.split_loggers = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] glance.timeout = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.backend_availability_zone = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.chap_password = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.chap_username = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.disk_geometry = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.driver_client_cert = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.driver_client_cert_key = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.driver_data_namespace = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.driver_use_ssl = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.extra_capabilities = {} {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.filter_function = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.goodness_function = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.iscsi_target_flags = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.iscsi_write_cache = on {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.iser_helper = tgtadm {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.iser_ip_address = 192.168.122.76 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.iser_port = 3260 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nas_host = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nas_login = admin {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nas_mount_options = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nas_password = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nas_private_key = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nas_share_path = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.num_shell_tries = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.quobyte_volume_url = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.replication_device = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.report_discard_supported = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.reserved_percentage = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.target_helper = tgtadm {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.target_ip_address = 192.168.122.76 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.target_port = 3260 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.target_protocol = iscsi {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.trace_flags = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.unique_fqdn_network = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.use_chap_auth = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.volume_backend_name = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.volume_clear = zero {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.volume_clear_ionice = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.volume_clear_size = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_reports.file_event_handler = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_reports.log_dir = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.backend_availability_zone = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.backend_host = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.chap_password = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.chap_username = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.chiscsi_conf = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.disk_geometry = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.driver_client_cert = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.driver_data_namespace = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.driver_use_ssl = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack quobyte-client[82039]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 10:31:44 devstack quobyte-client[82039]: Invalid parameters found, error: missing mount point. Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack quobyte-client[82039]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.extra_capabilities = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack quobyte-client[82039]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.filter_function = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.goodness_function = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.iser_helper = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.iser_ip_address = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.iser_port = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.iser_target_prefix = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nas_host = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nas_login = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nas_mount_options = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nas_password = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nas_private_key = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nas_share_path = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nas_ssh_port = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.num_shell_tries = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.nvmet_port_id = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] CMD "mount.quobyte" returned: 1 in 0.129s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.replication_device = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.report_discard_supported = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.reserved_percentage = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.scst_target_driver = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.storage_protocol = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.target_helper = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.target_ip_address = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.target_port = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.target_prefix = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.target_protocol = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.trace_flags = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.use_chap_auth = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.volume_clear = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.volume_clear_size = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] QuobyteHD.volumes_dir = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.ssl = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_notifications.driver = [] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_notifications.retry = -1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] key_manager.fixed_key = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.barbican_api_version = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.barbican_endpoint = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.barbican_endpoint_type = public {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.barbican_region_name = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.cafile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.certfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.collect_timing = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.insecure = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.keyfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.number_of_retries = 60 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.retry_delay = 1 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.send_service_user_token = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.split_loggers = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.timeout = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.verify_ssl = True {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican.verify_ssl_path = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican_service_user.auth_section = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican_service_user.auth_type = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican_service_user.cafile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican_service_user.certfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican_service_user.collect_timing = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican_service_user.insecure = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican_service_user.keyfile = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican_service_user.split_loggers = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] barbican_service_user.timeout = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.approle_role_id = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.approle_secret_id = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.kv_mountpoint = secret {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.kv_path = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.kv_version = 2 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.namespace = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.root_token_id = **** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.ssl_ca_crt_file = None {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.timeout = 60.0 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.use_ssl = False {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 10:31:44 devstack cinder-volume[81901]: DEBUG oslo_service.backend._eventlet.service [None req-d118748f-37ff-47b7-b9d7-ad6c7ae010d2 None None] ******************************************************************************** {{(pid=81901) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 10:31:44 devstack sudo[82061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:31:44 devstack sudo[82061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:44 devstack sudo[82061]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.569s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:44 devstack cinder-volume[82038]: INFO cinder.volume.driver [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG cinder.volume.driver [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82038) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 10:31:44 devstack cinder-volume[82038]: DEBUG oslo_db.sqlalchemy.engines [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82038) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writer thread running {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG cinder.db.sqlalchemy.api [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Building query based on filter {{(pid=82038) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82038) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:45 devstack cinder-volume[82038]: INFO cinder.keymgr.migration [None req-8b3c5be7-d5e7-497e-ba07-75bc29a0be8b None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 10:31:45 devstack sudo[82140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:31:45 devstack sudo[82140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:45 devstack sudo[82140]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.461s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:31:45 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Driver initialization completed successfully. Apr 10 10:31:45 devstack cinder-volume[82038]: INFO cinder.manager [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Initiating service 3 cleanup Apr 10 10:31:45 devstack cinder-volume[82038]: INFO cinder.manager [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Service 3 cleanup completed. Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG cinder.service [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Creating RPC server for service cinder-volume {{(pid=82038) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG cinder.service [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82038) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 10:31:45 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:31:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:31:45 devstack sudo[82155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:31:45 devstack sudo[82155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:31:46 devstack sudo[82155]: pam_unix(sudo:session): session closed for user root Apr 10 10:31:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.465s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:31:46 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0adba6ea-9c06-4f53-80c2-cec4a8fbeab8 None None] Driver post RPC initialization completed successfully. Apr 10 10:31:53 devstack cinder-volume[81901]: DEBUG dbcounter [-] [81901] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=81901) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:31:55 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=3 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:31:56 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:32:45 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Flow 'volume_create_manager' (397b0a4b-41f4-4981-89af-60811a737602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e531637-9cfe-4752-a2ac-f1a953864357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e531637-9cfe-4752-a2ac-f1a953864357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-105434794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7eae9e-6f71-4698-a34a-69bc060d4d66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37971ff6e3654b639a55cd82a740acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:46Z,use_quota=True,user_id='492bf5d622b644c1ae48a36f03bd2da1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97a0f61-3cbc-47a8-a245-09c3d58a8133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f97a0f61-3cbc-47a8-a245-09c3d58a8133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485dbd4e-99ce-4474-8df3-a770f199a181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (485dbd4e-99ce-4474-8df3-a770f199a181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b7eae9e-6f71-4698-a34a-69bc060d4d66', 'volume_name': 'volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02ca107-df6d-4e5b-803d-74d21ab9fff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b02ca107-df6d-4e5b-803d-74d21ab9fff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ea62a1-e495-454d-966a-164543ef329a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Volume 2b7eae9e-6f71-4698-a34a-69bc060d4d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66', 'volume_size': 1} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:31:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-105434794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b7eae9e-6f71-4698-a34a-69bc060d4d66,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37971ff6e3654b639a55cd82a740acb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:46Z,use_quota=True,user_id='492bf5d622b644c1ae48a36f03bd2da1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Creating volume 2b7eae9e-6f71-4698-a34a-69bc060d4d66 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:46 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:46 devstack sudo[82416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66 1073741824 Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:32:46 devstack sudo[82416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Flow 'volume_create_manager' (7b586614-e74b-4319-8be6-990d8897929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cbfa6a-1225-42ab-9d2a-df6e3ad50050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7cbfa6a-1225-42ab-9d2a-df6e3ad50050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1286245967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6daafd0-3bea-4984-85fc-82ff61d6abcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0596c1b6ae45949afd1b86cd386deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:46Z,use_quota=True,user_id='a163db66b084421f8bceb3e1aafcd600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2dcd96-22a7-47fd-b142-123fa1bc5e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2dcd96-22a7-47fd-b142-123fa1bc5e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b147c1c4-13b5-4e87-9034-b7cd7b006626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b147c1c4-13b5-4e87-9034-b7cd7b006626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6daafd0-3bea-4984-85fc-82ff61d6abcc', 'volume_name': 'volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c90ac03-8759-47d0-941a-b346b11297b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c90ac03-8759-47d0-941a-b346b11297b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47020f45-b228-4d8d-a3a2-11bc5bb9f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:46 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Volume c6daafd0-3bea-4984-85fc-82ff61d6abcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc', 'volume_size': 1} Apr 10 10:32:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:47 devstack sudo[82416]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66 1073741824" returned: 0 in 1.192s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:47 devstack sudo[82744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66 Apr 10 10:32:47 devstack sudo[82744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:48 devstack sudo[82744]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66" returned: 0 in 0.778s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.070s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.852s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:32:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1286245967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6daafd0-3bea-4984-85fc-82ff61d6abcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c0596c1b6ae45949afd1b86cd386deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:32:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:32:46Z,use_quota=True,user_id='a163db66b084421f8bceb3e1aafcd600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Creating volume c6daafd0-3bea-4984-85fc-82ff61d6abcc {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:32:48 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20ea62a1-e495-454d-966a-164543ef329a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8c4945-6a60-41ce-801f-3bf8f4523130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:48 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Volume volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66 (2b7eae9e-6f71-4698-a34a-69bc060d4d66): created successfully Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8c4945-6a60-41ce-801f-3bf8f4523130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Flow 'volume_create_manager' (397b0a4b-41f4-4981-89af-60811a737602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:48 devstack sudo[82747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc 1073741824 Apr 10 10:32:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-89f86bd3-1d36-4915-a4d1-86fbd9ce56ed req-af5c9970-83c2-4208-9c47-412acf7d0325 tempest-VolumesGetTestJSON-783815685 None] Created volume successfully. Apr 10 10:32:48 devstack sudo[82747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:49 devstack sudo[82747]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc 1073741824" returned: 0 in 1.815s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:50 devstack sudo[82789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc Apr 10 10:32:50 devstack sudo[82789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Acquiring lock "cinder-2b7eae9e-6f71-4698-a34a-69bc060d4d66-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Lock "cinder-2b7eae9e-6f71-4698-a34a-69bc060d4d66-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Acquiring lock "cinder-quobyte-2b7eae9e-6f71-4698-a34a-69bc060d4d66" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:32:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Lock "cinder-quobyte-2b7eae9e-6f71-4698-a34a-69bc060d4d66" acquired by "delete_volume" :: waited 0.036s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:32:50 devstack cinder-volume[82038]: INFO oslo.privsep.daemon [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpf21t518x/privsep.sock'] Apr 10 10:32:50 devstack sudo[82799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpf21t518x/privsep.sock Apr 10 10:32:50 devstack sudo[82799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:51 devstack sudo[82789]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc" returned: 0 in 1.688s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] <== create_volume: return (3592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:32:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.596s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47020f45-b228-4d8d-a3a2-11bc5bb9f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d663841a-c2df-451f-94cc-6dfdfd91a035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:32:51 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Volume volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc (c6daafd0-3bea-4984-85fc-82ff61d6abcc): created successfully Apr 10 10:32:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d663841a-c2df-451f-94cc-6dfdfd91a035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:32:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Flow 'volume_create_manager' (7b586614-e74b-4319-8be6-990d8897929e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:32:51 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ef5100a2-158c-416b-96eb-ad8c00ca1fbf tempest-DeleteServersTestJSON-2127674967 None] Created volume successfully. Apr 10 10:32:51 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 10 10:32:51 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:32:51 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 10:32:51 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:32:51 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:32:51 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 10:32:51 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:32:51 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:32:51 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 10 10:32:52 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 10 10:32:52 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 10:32:52 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 10:32:52 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:32:52 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 10:32:52 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 10:32:52 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 10:32:52 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 10:32:52 devstack cinder-volume[82038]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 10 10:32:53 devstack sudo[82799]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:53 devstack cinder-volume[82038]: INFO oslo.privsep.daemon [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Spawned new privsep daemon via rootwrap Apr 10 10:32:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Accepted privsep connection to /tmp/tmpf21t518x/privsep.sock {{(pid=82038) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 10 10:32:53 devstack cinder-volume[82038]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 10 10:32:53 devstack cinder-volume[82038]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 10 10:32:53 devstack cinder-volume[82038]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 10 10:32:53 devstack cinder-volume[82038]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82807 Apr 10 10:32:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e8fa89-c4c6-40d5-af25-f3216a415c8b]: (2,) {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[da61339c-0a6a-4d34-8bf5-6e0fc3a6c1cd]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:32:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:53 devstack sudo[82809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66 Apr 10 10:32:53 devstack sudo[82809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:55 devstack sudo[82809]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66" returned: 0 in 1.593s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:55 devstack sudo[82821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66 Apr 10 10:32:55 devstack sudo[82821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:56 devstack sudo[82821]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b7eae9e-6f71-4698-a34a-69bc060d4d66" returned: 0 in 1.242s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Lock "cinder-quobyte-2b7eae9e-6f71-4698-a34a-69bc060d4d66" released by "delete_volume" :: held 5.998s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:32:56 devstack cinder-volume[82038]: WARNING cinder.quota [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:56 devstack cinder-volume[82038]: WARNING cinder.quota [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:32:56 devstack cinder-volume[82038]: DEBUG cinder.quota [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Created reservations ['42572ef2-d652-4821-98d3-b00b53fb9899', '7894d2ba-6c89-49ec-be63-412af7bedb36', '3e1ff155-8392-43dd-bb98-dca94643d475', '03a243db-6c19-4ed7-9bb3-d14bd97cd067'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:32:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:32:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:32:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:32:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:32:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:32:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:32:57 devstack sudo[82881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:32:57 devstack sudo[82881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:32:58 devstack sudo[82881]: pam_unix(sudo:session): session closed for user root Apr 10 10:32:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.275s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:32:58 devstack cinder-volume[82038]: DEBUG cinder.manager [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:32:58 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Deleted volume successfully. Apr 10 10:32:58 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-08ee7473-8ea8-454d-bfc6-b5585016e1c2 req-f025a87f-f4ae-4928-bef8-d5f6253be909 tempest-VolumesGetTestJSON-783815685 None] Lock "cinder-2b7eae9e-6f71-4698-a34a-69bc060d4d66-delete_volume" released by "delete_volume" :: held 8.129s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:00 devstack cinder-volume[82038]: WARNING py.warnings [req-041b5829-1354-4440-acc9-a681379b22dc req-d5f08b49-3c7c-43f4-bd9c-ef45ea601d8c tempest-DeleteServersTestJSON-2127674967 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 10 10:33:00 devstack cinder-volume[82038]: .first() Apr 10 10:33:00 devstack cinder-volume[82038]: Apr 10 10:33:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-041b5829-1354-4440-acc9-a681379b22dc req-d5f08b49-3c7c-43f4-bd9c-ef45ea601d8c tempest-DeleteServersTestJSON-2127674967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-041b5829-1354-4440-acc9-a681379b22dc req-d5f08b49-3c7c-43f4-bd9c-ef45ea601d8c tempest-DeleteServersTestJSON-2127674967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:00 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e69c2b-1ef7-4a71-962a-ffefb97c26f0]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-041b5829-1354-4440-acc9-a681379b22dc req-d5f08b49-3c7c-43f4-bd9c-ef45ea601d8c tempest-DeleteServersTestJSON-2127674967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:00 devstack sudo[82936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc Apr 10 10:33:00 devstack sudo[82936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:02 devstack sudo[82936]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-041b5829-1354-4440-acc9-a681379b22dc req-d5f08b49-3c7c-43f4-bd9c-ef45ea601d8c tempest-DeleteServersTestJSON-2127674967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc" returned: 0 in 1.674s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-041b5829-1354-4440-acc9-a681379b22dc req-d5f08b49-3c7c-43f4-bd9c-ef45ea601d8c tempest-DeleteServersTestJSON-2127674967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.699s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-041b5829-1354-4440-acc9-a681379b22dc req-d5f08b49-3c7c-43f4-bd9c-ef45ea601d8c tempest-DeleteServersTestJSON-2127674967 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e', 'name': 'volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2f5768a-49cd-4b2b-a0eb-a3d0d9be5299', 'enforce_multipath': True} {{(pid=82038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 10:33:02 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-041b5829-1354-4440-acc9-a681379b22dc req-d5f08b49-3c7c-43f4-bd9c-ef45ea601d8c tempest-DeleteServersTestJSON-2127674967 None] attachment_update completed successfully. Apr 10 10:33:05 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Flow 'volume_create_manager' (b797dad9-d8c3-4530-a2c6-22ec648f2e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9070657d-37b0-40f8-ba20-db5c3a9c35ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9070657d-37b0-40f8-ba20-db5c3a9c35ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1365389380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e795716-4b71-4bba-94f1-37c182db374a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559f6529ee4f28b26622f5423b98ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:06Z,use_quota=True,user_id='e83ba45a8ce34e2cbb3897f8f1f5b467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b03291-8792-4a81-a578-7a9d643ec269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53b03291-8792-4a81-a578-7a9d643ec269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ac8bc2-0e70-4182-8fb5-26d16e527338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ac8bc2-0e70-4182-8fb5-26d16e527338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e795716-4b71-4bba-94f1-37c182db374a', 'volume_name': 'volume-3e795716-4b71-4bba-94f1-37c182db374a', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c938f1-fba3-48e0-98dd-7ec3d5a456bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c938f1-fba3-48e0-98dd-7ec3d5a456bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b32035-f24c-4ff5-a38b-1a893cbcc525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:06 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Volume 3e795716-4b71-4bba-94f1-37c182db374a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e795716-4b71-4bba-94f1-37c182db374a', 'volume_size': 1} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1365389380',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e795716-4b71-4bba-94f1-37c182db374a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559f6529ee4f28b26622f5423b98ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:06Z,use_quota=True,user_id='e83ba45a8ce34e2cbb3897f8f1f5b467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Creating volume 3e795716-4b71-4bba-94f1-37c182db374a {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:06 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:33:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:06 devstack sudo[83329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a 1073741824 Apr 10 10:33:06 devstack sudo[83329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:07 devstack sudo[83329]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a 1073741824" returned: 0 in 1.502s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:07 devstack sudo[83335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a Apr 10 10:33:07 devstack sudo[83335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3226994a-33b9-4292-a634-f0e351fb05ac tempest-BackendsCapabilitiesAdminTestsJSON-851468609 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82038) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 10:33:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-622eb060-aab8-40e3-ad49-930fd1ab77cf tempest-BackendsCapabilitiesAdminTestsJSON-851468609 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579803466797, 'free_capacity_gb': 1775.7579803466797, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82038) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 10:33:08 devstack sudo[83335]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a" returned: 0 in 1.210s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] <== create_volume: return (2773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.776s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b32035-f24c-4ff5-a38b-1a893cbcc525) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e795716-4b71-4bba-94f1-37c182db374a', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ccd81f5-1bb4-474c-bec4-ebd5e3b9421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:08 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Volume volume-3e795716-4b71-4bba-94f1-37c182db374a (3e795716-4b71-4bba-94f1-37c182db374a): created successfully Apr 10 10:33:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ccd81f5-1bb4-474c-bec4-ebd5e3b9421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Flow 'volume_create_manager' (b797dad9-d8c3-4530-a2c6-22ec648f2e3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:08 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-fe44e730-e2cb-4713-b534-dd09c5e83b9b tempest-ServersNegativeTestJSON-965118296 None] Created volume successfully. Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Flow 'volume_create_manager' (2ec16c76-ef02-4bf6-86c9-a7f41a1f6f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbbebdf-3bd9-4847-b5bf-8493bb75e6b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fbbebdf-3bd9-4847-b5bf-8493bb75e6b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1969688136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d98046-5b12-49b1-88ff-7ae2086d8f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559f6529ee4f28b26622f5423b98ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:12Z,use_quota=True,user_id='e83ba45a8ce34e2cbb3897f8f1f5b467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3572be20-66c3-41a1-8cd0-24231731f221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3572be20-66c3-41a1-8cd0-24231731f221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c772ce5-3a5f-4530-88ef-554386e1dd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c772ce5-3a5f-4530-88ef-554386e1dd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13d98046-5b12-49b1-88ff-7ae2086d8f44', 'volume_name': 'volume-13d98046-5b12-49b1-88ff-7ae2086d8f44', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07634a9-3c0a-4223-9059-b9643691cbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e07634a9-3c0a-4223-9059-b9643691cbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb4a6a9-1438-42d0-baa1-63640bb9cb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:11 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Volume 13d98046-5b12-49b1-88ff-7ae2086d8f44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13d98046-5b12-49b1-88ff-7ae2086d8f44', 'volume_size': 1} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1969688136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13d98046-5b12-49b1-88ff-7ae2086d8f44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a559f6529ee4f28b26622f5423b98ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:12Z,use_quota=True,user_id='e83ba45a8ce34e2cbb3897f8f1f5b467',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Creating volume 13d98046-5b12-49b1-88ff-7ae2086d8f44 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:11 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:33:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:11 devstack sudo[83387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44 1073741824 Apr 10 10:33:11 devstack sudo[83387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:13 devstack sudo[83387]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44 1073741824" returned: 0 in 1.133s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:13 devstack sudo[83393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44 Apr 10 10:33:13 devstack sudo[83393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:13 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-4acd836d-feb7-4883-959e-f3c49ee50727 req-25d8bbdd-8049-4e3e-8d49-3a01c6ad7405 tempest-DeleteServersTestJSON-2127674967 None] Terminate volume connection completed successfully. Apr 10 10:33:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-4acd836d-feb7-4883-959e-f3c49ee50727 req-25d8bbdd-8049-4e3e-8d49-3a01c6ad7405 tempest-DeleteServersTestJSON-2127674967 None] Deleting attachment b2f5768a-49cd-4b2b-a0eb-a3d0d9be5299. {{(pid=82038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 10:33:13 devstack sudo[83393]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44" returned: 0 in 0.681s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] <== create_volume: return (1874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cb4a6a9-1438-42d0-baa1-63640bb9cb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13d98046-5b12-49b1-88ff-7ae2086d8f44', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a5b6ed-5d95-41cc-84e7-bdcabb484578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:13 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Volume volume-13d98046-5b12-49b1-88ff-7ae2086d8f44 (13d98046-5b12-49b1-88ff-7ae2086d8f44): created successfully Apr 10 10:33:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06a5b6ed-5d95-41cc-84e7-bdcabb484578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Flow 'volume_create_manager' (2ec16c76-ef02-4bf6-86c9-a7f41a1f6f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:13 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-53469d2c-0393-4e31-b472-3aa7b8e784db tempest-ServersNegativeTestJSON-965118296 None] Created volume successfully. Apr 10 10:33:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Acquiring lock "cinder-13d98046-5b12-49b1-88ff-7ae2086d8f44-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Lock "cinder-13d98046-5b12-49b1-88ff-7ae2086d8f44-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Acquiring lock "cinder-quobyte-13d98046-5b12-49b1-88ff-7ae2086d8f44" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Lock "cinder-quobyte-13d98046-5b12-49b1-88ff-7ae2086d8f44" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:14 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4037998-634f-4c85-b058-e66574dbf42a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:15 devstack sudo[83396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44 Apr 10 10:33:15 devstack sudo[83396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:15 devstack sudo[83396]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44" returned: 0 in 0.851s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:15 devstack sudo[83402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44 Apr 10 10:33:15 devstack sudo[83402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:16 devstack sudo[83402]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-13d98046-5b12-49b1-88ff-7ae2086d8f44" returned: 0 in 0.644s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Lock "cinder-quobyte-13d98046-5b12-49b1-88ff-7ae2086d8f44" released by "delete_volume" :: held 1.530s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Created reservations ['ecc7adcc-3183-4c4b-a6a7-2001060e999e', '88515c41-f946-41b0-aa68-b3ad23ad2d4f', 'c6c7136c-b29d-4b11-af32-89a9a4876a5b', '503e5a7b-a118-4633-8ced-21cd71850e44'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:16 devstack sudo[83405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:33:16 devstack sudo[83405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Acquiring lock "cinder-c6daafd0-3bea-4984-85fc-82ff61d6abcc-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Lock "cinder-c6daafd0-3bea-4984-85fc-82ff61d6abcc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Acquiring lock "cinder-quobyte-c6daafd0-3bea-4984-85fc-82ff61d6abcc" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Lock "cinder-quobyte-c6daafd0-3bea-4984-85fc-82ff61d6abcc" acquired by "delete_volume" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4a21d5-4a87-4b75-bcfc-badf7727db2f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Acquiring lock "cinder-3e795716-4b71-4bba-94f1-37c182db374a-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Lock "cinder-3e795716-4b71-4bba-94f1-37c182db374a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Acquiring lock "cinder-quobyte-3e795716-4b71-4bba-94f1-37c182db374a" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Lock "cinder-quobyte-3e795716-4b71-4bba-94f1-37c182db374a" acquired by "delete_volume" :: waited 0.024s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a926733-512c-477f-bfe2-c30b1662e92f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:17 devstack sudo[83407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc Apr 10 10:33:17 devstack sudo[83407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:17 devstack sudo[83408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a Apr 10 10:33:17 devstack sudo[83408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:17 devstack sudo[83405]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.889s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:17 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Deleted volume successfully. Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7dd142ad-994c-4b6b-a2c6-f185296c73aa tempest-ServersNegativeTestJSON-965118296 None] Lock "cinder-13d98046-5b12-49b1-88ff-7ae2086d8f44-delete_volume" released by "delete_volume" :: held 2.647s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:17 devstack sudo[83407]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc" returned: 0 in 0.958s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:18 devstack sudo[83418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc Apr 10 10:33:18 devstack sudo[83418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:18 devstack sudo[83408]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a" returned: 0 in 0.856s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:18 devstack sudo[83420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a Apr 10 10:33:18 devstack sudo[83420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:18 devstack sudo[83418]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c6daafd0-3bea-4984-85fc-82ff61d6abcc" returned: 0 in 0.667s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Lock "cinder-quobyte-c6daafd0-3bea-4984-85fc-82ff61d6abcc" released by "delete_volume" :: held 1.663s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:18 devstack sudo[83420]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3e795716-4b71-4bba-94f1-37c182db374a" returned: 0 in 0.619s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Lock "cinder-quobyte-3e795716-4b71-4bba-94f1-37c182db374a" released by "delete_volume" :: held 1.517s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Created reservations ['5494d761-a1b2-470f-a367-1540845b39dd', '0ffa3126-34f2-44c0-b00c-5f45cc0272ad', '06ea412c-09d3-4e02-9d3f-c6d8e3b90b43', '1f80af04-cb42-4a6b-ab96-4ff7bdc8fd59'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Created reservations ['d2f82a9c-fe37-49e8-b308-2f5b8da97ab8', '9d0e0b43-db06-45bf-a490-d4864e3d0f97', 'fbbfe9ff-98ce-404d-ae7c-6c9dc0844786', '01dbc281-0ca3-45b9-9073-99dd37e10180'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:18 devstack sudo[83425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:33:18 devstack sudo[83425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:18 devstack sudo[83427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:33:18 devstack sudo[83427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:19 devstack sudo[83427]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.754s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:19 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:19 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Deleted volume successfully. Apr 10 10:33:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dfdb3891-d15f-4e3a-8c10-afab1efe54ed tempest-ServersNegativeTestJSON-965118296 None] Lock "cinder-3e795716-4b71-4bba-94f1-37c182db374a-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:19 devstack sudo[83425]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.857s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:19 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:19 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Deleted volume successfully. Apr 10 10:33:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-60d0abf2-5b83-4c8b-a4d3-3e1ca718e36a tempest-DeleteServersTestJSON-2127674967 None] Lock "cinder-c6daafd0-3bea-4984-85fc-82ff61d6abcc-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:21 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4884f282-da36-428e-81c5-2b6005dd36d9 tempest-GroupsV314Test-717460040 None] Group tempest-GroupsV314Test-Group-930628260: creating Apr 10 10:33:21 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4884f282-da36-428e-81c5-2b6005dd36d9 tempest-GroupsV314Test-717460040 None] Group tempest-GroupsV314Test-Group-930628260: created successfully Apr 10 10:33:21 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4884f282-da36-428e-81c5-2b6005dd36d9 tempest-GroupsV314Test-717460040 None] Create group completed successfully. Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Flow 'volume_create_manager' (a89cc614-3646-4f86-8b6d-2e84e1b12760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465b8675-a8a7-44b4-8a43-e491eb7550d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (465b8675-a8a7-44b4-8a43-e491eb7550d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-681165061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f529129-4381-4e6e-af1c-8302d7d9da80,host='devstack@QuobyteHD#QuobyteHD',id=f9053a40-85b9-472e-b009-a79bcdc47747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab4702a1cac49d5bfc9e0d3d828952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:23Z,use_quota=True,user_id='f31a83823a104253808dcb0bfff5774a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a467d41-fa5a-4794-9723-9b84add99bf3),volume_type_id=2a467d41-fa5a-4794-9723-9b84add99bf3)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0334b424-4609-4397-9351-fcaf8d7a06b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0334b424-4609-4397-9351-fcaf8d7a06b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d21ad98-6186-4c29-80e0-11659d6a854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d21ad98-6186-4c29-80e0-11659d6a854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9053a40-85b9-472e-b009-a79bcdc47747', 'volume_name': 'volume-f9053a40-85b9-472e-b009-a79bcdc47747', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b289d6b6-80ed-41d5-9eac-df130efb3fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b289d6b6-80ed-41d5-9eac-df130efb3fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a0ed8f-b8f6-46ff-a7ef-09a7fd60f033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:22 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Volume f9053a40-85b9-472e-b009-a79bcdc47747: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9053a40-85b9-472e-b009-a79bcdc47747', 'volume_size': 1} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3f529129-4381-4e6e-af1c-8302d7d9da80,created_at=2026-04-10T08:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-681165061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f529129-4381-4e6e-af1c-8302d7d9da80,host='devstack@QuobyteHD#QuobyteHD',id=f9053a40-85b9-472e-b009-a79bcdc47747,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eab4702a1cac49d5bfc9e0d3d828952b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:23Z,use_quota=True,user_id='f31a83823a104253808dcb0bfff5774a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a467d41-fa5a-4794-9723-9b84add99bf3),volume_type_id=2a467d41-fa5a-4794-9723-9b84add99bf3)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Creating volume f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:22 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:33:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:22 devstack sudo[83459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 1073741824 Apr 10 10:33:22 devstack sudo[83459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:23 devstack sudo[83459]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 1073741824" returned: 0 in 0.779s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:23 devstack sudo[83464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 Apr 10 10:33:23 devstack sudo[83464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:24 devstack sudo[83464]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747" returned: 0 in 0.606s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49a0ed8f-b8f6-46ff-a7ef-09a7fd60f033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9053a40-85b9-472e-b009-a79bcdc47747', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005f5501-dde0-432a-89d1-cdc558d49267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:24 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Volume volume-f9053a40-85b9-472e-b009-a79bcdc47747 (f9053a40-85b9-472e-b009-a79bcdc47747): created successfully Apr 10 10:33:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (005f5501-dde0-432a-89d1-cdc558d49267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Flow 'volume_create_manager' (a89cc614-3646-4f86-8b6d-2e84e1b12760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:24 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-300c9575-04ac-47fd-84b7-15a666bfc524 tempest-GroupsV314Test-717460040 None] Created volume successfully. Apr 10 10:33:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:25 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Cloning volume f9053a40-85b9-472e-b009-a79bcdc47747 to volume 5d843ec4-334f-444a-9b53-1fb75997b952 Apr 10 10:33:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Creating offline snapshot f13f6475-d1dd-47f3-a513-237a98bc6b3b of volume f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:33:26 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[837950f8-b52d-40a2-adfd-87304169f9c6]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:26 devstack sudo[83469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 Apr 10 10:33:26 devstack sudo[83469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:26 devstack sudo[83469]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747" returned: 0 in 0.803s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:26 devstack sudo[83474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b 1G Apr 10 10:33:26 devstack sudo[83474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:27 devstack sudo[83474]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b 1G" returned: 0 in 0.746s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9053a40-85b9-472e-b009-a79bcdc47747 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:27 devstack sudo[83479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9053a40-85b9-472e-b009-a79bcdc47747 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b Apr 10 10:33:27 devstack sudo[83479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:28 devstack sudo[83479]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9053a40-85b9-472e-b009-a79bcdc47747 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b" returned: 0 in 0.603s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:28 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:33:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:28 devstack sudo[83484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b Apr 10 10:33:28 devstack sudo[83484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:28 devstack sudo[83484]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b" returned: 0 in 0.556s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:28 devstack sudo[83487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.info Apr 10 10:33:28 devstack sudo[83487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:29 devstack sudo[83487]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.info" returned: 0 in 0.581s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:29 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:29 devstack sudo[83490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.info Apr 10 10:33:29 devstack sudo[83490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:29 devstack sudo[83490]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.info" returned: 0 in 0.558s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Acquiring lock "cinder-quobyte-5d843ec4-334f-444a-9b53-1fb75997b952" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Lock "cinder-quobyte-5d843ec4-334f-444a-9b53-1fb75997b952" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] snapshot: f13f6475-d1dd-47f3-a513-237a98bc6b3b, volume: 5d843ec4-334f-444a-9b53-1fb75997b952, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9eeec5-97dd-4422-9c6b-575e02d127bb]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:30 devstack sudo[83493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b Apr 10 10:33:30 devstack sudo[83493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:30 devstack sudo[83493]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b" returned: 0 in 0.653s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9053a40-85b9-472e-b009-a79bcdc47747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:33:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:33:30 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8d44fb-eccb-4531-8209-1ecf06544ff6]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:30 devstack sudo[83499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 Apr 10 10:33:30 devstack sudo[83499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:31 devstack sudo[83499]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747" returned: 0 in 0.646s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:31 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:33:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:31 devstack sudo[83504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 Apr 10 10:33:31 devstack sudo[83504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:34 devstack sudo[83504]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952" returned: 0 in 3.284s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:34 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2361468a-092d-46b4-8523-1700beb73557]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:34 devstack sudo[83534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 Apr 10 10:33:34 devstack sudo[83534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:35 devstack sudo[83534]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747" returned: 0 in 0.807s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747, size 1024.00 MB, duration 3.28 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:33:35 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Converted 1024.00 MB image at 311.74 MB/s Apr 10 10:33:35 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:35 devstack sudo[83539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 Apr 10 10:33:35 devstack sudo[83539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:35 devstack sudo[83539]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952" returned: 0 in 0.526s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Lock "cinder-quobyte-5d843ec4-334f-444a-9b53-1fb75997b952" released by "_copy_volume_from_snapshot" :: held 5.977s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Acquiring lock "cinder-quobyte-f13f6475-d1dd-47f3-a513-237a98bc6b3b" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Lock "cinder-quobyte-f13f6475-d1dd-47f3-a513-237a98bc6b3b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Deleting offline snapshot f13f6475-d1dd-47f3-a513-237a98bc6b3b of volume f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] snapshot_file for this snap is: volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f80c49-3a2b-40ce-ae7e-493fcb66febe]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:36 devstack sudo[83542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b Apr 10 10:33:36 devstack sudo[83542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:36 devstack sudo[83542]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b" returned: 0 in 0.749s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9053a40-85b9-472e-b009-a79bcdc47747(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:36 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8deb1a8a-d51a-42ef-8c00-343d9d9ae61f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:36 devstack sudo[83547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 Apr 10 10:33:36 devstack sudo[83547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:37 devstack sudo[83547]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747" returned: 0 in 0.865s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:37 devstack sudo[83552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b Apr 10 10:33:37 devstack sudo[83552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:38 devstack sudo[83552]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b" returned: 0 in 0.684s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:38 devstack sudo[83557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b Apr 10 10:33:38 devstack sudo[83557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:38 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=41,cinder:INSERT=10,cinder:DELETE=5,cinder:UPDATE=46 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:33:38 devstack sudo[83557]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747.f13f6475-d1dd-47f3-a513-237a98bc6b3b" returned: 0 in 0.591s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Lock "cinder-quobyte-f13f6475-d1dd-47f3-a513-237a98bc6b3b" released by "_delete_snapshot" :: held 2.999s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:38 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:UPDATE=56,cinder:SELECT=46,cinder:INSERT=13,cinder:DELETE=4 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:33:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.983s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:39 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c9655406-7a4e-4e3d-8a75-af45f5c49eea tempest-GroupsV314Test-717460040 None] Create group from source-group-3f529129-4381-4e6e-af1c-8302d7d9da80 completed successfully. Apr 10 10:33:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:33:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:39 devstack sudo[83560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:33:39 devstack sudo[83560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:39 devstack sudo[83560]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.633s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:39 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Acquiring lock "cinder-quobyte-5d843ec4-334f-444a-9b53-1fb75997b952" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Lock "cinder-quobyte-5d843ec4-334f-444a-9b53-1fb75997b952" acquired by "delete_volume" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:40 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd1eb12-2f8c-4ccd-a84d-ebb19a1e3dd7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:40 devstack sudo[83565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 Apr 10 10:33:40 devstack sudo[83565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:40 devstack sudo[83565]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952" returned: 0 in 0.739s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:40 devstack sudo[83570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952 Apr 10 10:33:40 devstack sudo[83570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:41 devstack sudo[83570]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5d843ec4-334f-444a-9b53-1fb75997b952" returned: 0 in 0.694s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Lock "cinder-quobyte-5d843ec4-334f-444a-9b53-1fb75997b952" released by "delete_volume" :: held 1.479s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:41 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Created reservations ['f5989520-fb0f-4b67-b37f-9fa4c978cedc'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:41 devstack cinder-volume[82038]: WARNING cinder.quota [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-617952173 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-617952173, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:41 devstack cinder-volume[82038]: WARNING cinder.quota [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-617952173 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-617952173, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:41 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Created reservations ['93775e84-3bfb-4d8b-9b94-30ec6d6fb94d', 'b12e30a7-46e9-4c84-a14c-75e6611ee12d', '32af1bbb-f9b6-4bfc-b625-badad641f511', '9f505c93-58aa-4499-bf2c-373af616b65a'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:41 devstack sudo[83573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:33:41 devstack sudo[83573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:42 devstack sudo[83573]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.656s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:42 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-99948585-8408-4a8a-a8ad-4899ea3f0b65 tempest-GroupsV314Test-717460040 None] Delete group completed successfully. Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Flow 'volume_create_manager' (ff27d628-b738-46c6-84e3-104b32a93927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23771905-4c2c-45d3-b6c1-5d5eb9500e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23771905-4c2c-45d3-b6c1-5d5eb9500e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2117952810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d83adbd-eede-4dca-860a-d7f2212ac945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45327ad81b3e4fb8a306eba9d7fb4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:42Z,use_quota=True,user_id='69ce3b71cb144c3c8ca20b7dafe87f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52026425-1cc8-4655-8829-79c83665f286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52026425-1cc8-4655-8829-79c83665f286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf0cfe0-732f-429b-aa61-daa15b1fe59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faf0cfe0-732f-429b-aa61-daa15b1fe59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d83adbd-eede-4dca-860a-d7f2212ac945', 'volume_name': 'volume-2d83adbd-eede-4dca-860a-d7f2212ac945', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d53bdc2-6885-4685-8700-34d1f2ad618b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d53bdc2-6885-4685-8700-34d1f2ad618b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa103991-80c9-4812-a777-1d2d8e6cafca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:42 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Volume 2d83adbd-eede-4dca-860a-d7f2212ac945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d83adbd-eede-4dca-860a-d7f2212ac945', 'volume_size': 1} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:33:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2117952810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d83adbd-eede-4dca-860a-d7f2212ac945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45327ad81b3e4fb8a306eba9d7fb4994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:33:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:33:42Z,use_quota=True,user_id='69ce3b71cb144c3c8ca20b7dafe87f33',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Creating volume 2d83adbd-eede-4dca-860a-d7f2212ac945 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:33:42 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:42 devstack sudo[83577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 1073741824 Apr 10 10:33:42 devstack sudo[83577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Acquiring lock "cinder-quobyte-f9053a40-85b9-472e-b009-a79bcdc47747" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Lock "cinder-quobyte-f9053a40-85b9-472e-b009-a79bcdc47747" acquired by "delete_volume" :: waited 0.025s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f236f469-4126-4d51-aac0-bffe7d8a9b5a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:42 devstack sudo[83579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 Apr 10 10:33:42 devstack sudo[83579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:43 devstack sudo[83579]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747" returned: 0 in 0.681s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:43 devstack sudo[83577]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 1073741824" returned: 0 in 0.819s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:43 devstack sudo[83587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747 Apr 10 10:33:43 devstack sudo[83587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:43 devstack sudo[83589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 Apr 10 10:33:43 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:44 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945" returned: 0 in 0.649s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa103991-80c9-4812-a777-1d2d8e6cafca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d83adbd-eede-4dca-860a-d7f2212ac945', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b398635e-a0ab-4601-a01e-58a8343de779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:33:44 devstack sudo[83587]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f9053a40-85b9-472e-b009-a79bcdc47747" returned: 0 in 0.736s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:44 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Volume volume-2d83adbd-eede-4dca-860a-d7f2212ac945 (2d83adbd-eede-4dca-860a-d7f2212ac945): created successfully Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b398635e-a0ab-4601-a01e-58a8343de779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Flow 'volume_create_manager' (ff27d628-b738-46c6-84e3-104b32a93927) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Lock "cinder-quobyte-f9053a40-85b9-472e-b009-a79bcdc47747" released by "delete_volume" :: held 1.489s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-a49912fc-c7e3-4c7a-9f9e-641b5cadeed7 req-06e567da-66f8-4bc5-a65b-59710024e9be tempest-VolumesSnapshotsTestJSON-908917916 None] Created volume successfully. Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Created reservations ['101de08c-be37-48a2-a81a-d466e89e104e'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Created reservations ['4a9867e1-997e-4d85-897f-084171e77045', '2c130faf-316b-4d7e-beb3-f86ac40b1597', '1ae0f2e1-19ba-4e1b-ba4a-bc9493a0ebee', 'ef274499-3d83-4ead-98c0-2c2301238842'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:44 devstack sudo[83593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:33:44 devstack sudo[83593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Creating offline snapshot 5709e15e-070c-43c8-bdaf-bb8fa101b8e7 of volume 2d83adbd-eede-4dca-860a-d7f2212ac945 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:33:45 devstack sudo[83593]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.060s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:45 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:45 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ff5d2d8e-9ce0-45a5-8be9-f1d7930888ef tempest-GroupsV314Test-717460040 None] Delete group completed successfully. Apr 10 10:33:45 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90e10bc-fa3a-4b92-9166-6b96c0a7c3cb]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:45 devstack sudo[83596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 Apr 10 10:33:45 devstack sudo[83596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:46 devstack sudo[83596]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945" returned: 0 in 0.950s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:46 devstack sudo[83601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 1G Apr 10 10:33:46 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:47 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 1G" returned: 0 in 0.794s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d83adbd-eede-4dca-860a-d7f2212ac945 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:47 devstack sudo[83621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d83adbd-eede-4dca-860a-d7f2212ac945 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 Apr 10 10:33:47 devstack sudo[83621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:48 devstack sudo[83621]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d83adbd-eede-4dca-860a-d7f2212ac945 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7" returned: 0 in 0.768s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:48 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 is being set with open permissions: ugo+rw Apr 10 10:33:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:48 devstack sudo[83633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 Apr 10 10:33:48 devstack sudo[83633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:48 devstack sudo[83633]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7" returned: 0 in 0.655s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:48 devstack sudo[83640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.info Apr 10 10:33:48 devstack sudo[83640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:49 devstack sudo[83640]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.info" returned: 0 in 0.768s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:49 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.info is being set with open permissions: ugo+rw Apr 10 10:33:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:49 devstack sudo[83654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.info Apr 10 10:33:49 devstack sudo[83654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:50 devstack sudo[83654]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.info" returned: 0 in 0.742s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.825s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:50 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-ff91be91-0dfe-400a-8580-725dd5804b71 req-038b834d-a06b-4d70-8242-cb67c5e0ad6a tempest-VolumesSnapshotsTestJSON-908917916 None] Create snapshot completed successfully Apr 10 10:33:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Acquiring lock "cinder-5709e15e-070c-43c8-bdaf-bb8fa101b8e7-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "cinder-5709e15e-070c-43c8-bdaf-bb8fa101b8e7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Acquiring lock "cinder-quobyte-2d83adbd-eede-4dca-860a-d7f2212ac945" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "cinder-quobyte-2d83adbd-eede-4dca-860a-d7f2212ac945" acquired by "delete_snapshot" :: waited 0.034s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Acquiring lock "cinder-quobyte-5709e15e-070c-43c8-bdaf-bb8fa101b8e7" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "cinder-quobyte-5709e15e-070c-43c8-bdaf-bb8fa101b8e7" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Deleting offline snapshot 5709e15e-070c-43c8-bdaf-bb8fa101b8e7 of volume 2d83adbd-eede-4dca-860a-d7f2212ac945 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:33:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] snapshot_file for this snap is: volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:33:51 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1519e393-a50f-4f73-b7c3-9013775d6a5b]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:51 devstack sudo[83662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 Apr 10 10:33:51 devstack sudo[83662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:51 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b71e5b16-4138-44cf-ab28-32a809e517e1 tempest-GroupsV320Test-1341105995 None] Group tempest-GroupsV320Test-Group-132428747: creating Apr 10 10:33:51 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b71e5b16-4138-44cf-ab28-32a809e517e1 tempest-GroupsV320Test-1341105995 None] Group tempest-GroupsV320Test-Group-132428747: created successfully Apr 10 10:33:51 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b71e5b16-4138-44cf-ab28-32a809e517e1 tempest-GroupsV320Test-1341105995 None] Create group completed successfully. Apr 10 10:33:52 devstack sudo[83662]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7" returned: 0 in 0.974s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:52 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d83adbd-eede-4dca-860a-d7f2212ac945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:33:52 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0300330f-25b9-46ff-857d-77d510725ca5]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:52 devstack sudo[83681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 Apr 10 10:33:52 devstack sudo[83681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:52 devstack sudo[83681]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945" returned: 0 in 0.659s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:52 devstack sudo[83687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 Apr 10 10:33:52 devstack sudo[83687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:53 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-0f4c0a20-b5f1-4ae8-9d45-96aea1de72ca tempest-GroupsV320Test-1341105995 None] Created reservations ['eea5a99b-19c9-4b0b-9788-39c25d6349a7'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0f4c0a20-b5f1-4ae8-9d45-96aea1de72ca tempest-GroupsV320Test-1341105995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0f4c0a20-b5f1-4ae8-9d45-96aea1de72ca tempest-GroupsV320Test-1341105995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c0a20-b5f1-4ae8-9d45-96aea1de72ca tempest-GroupsV320Test-1341105995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c0a20-b5f1-4ae8-9d45-96aea1de72ca tempest-GroupsV320Test-1341105995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0f4c0a20-b5f1-4ae8-9d45-96aea1de72ca tempest-GroupsV320Test-1341105995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0f4c0a20-b5f1-4ae8-9d45-96aea1de72ca tempest-GroupsV320Test-1341105995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:53 devstack sudo[83701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:33:53 devstack sudo[83701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:53 devstack sudo[83687]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7" returned: 0 in 0.787s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:53 devstack sudo[83703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7 Apr 10 10:33:53 devstack sudo[83703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:54 devstack sudo[83703]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945.5709e15e-070c-43c8-bdaf-bb8fa101b8e7" returned: 0 in 0.501s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:54 devstack sudo[83701]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0f4c0a20-b5f1-4ae8-9d45-96aea1de72ca tempest-GroupsV320Test-1341105995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.625s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-0f4c0a20-b5f1-4ae8-9d45-96aea1de72ca tempest-GroupsV320Test-1341105995 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "cinder-quobyte-5709e15e-070c-43c8-bdaf-bb8fa101b8e7" released by "_delete_snapshot" :: held 3.062s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "cinder-quobyte-2d83adbd-eede-4dca-860a-d7f2212ac945" released by "delete_snapshot" :: held 3.098s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:54 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0f4c0a20-b5f1-4ae8-9d45-96aea1de72ca tempest-GroupsV320Test-1341105995 None] Delete group completed successfully. Apr 10 10:33:54 devstack cinder-volume[82038]: WARNING cinder.quota [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG cinder.quota [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Created reservations ['d1d4231a-469a-4ab7-a1f3-a22dd7bf749c', 'dd70aa6e-32d4-4bf0-8e50-b4ad82a26cb3', '7eb0e281-3b92-4250-a662-d8f9698ffb27', '8716405d-816a-4a9c-b82c-3237fb84c5bf'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:54 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Delete snapshot completed successfully. Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-9b5501ff-1d4e-4a8f-a38f-5cc6de183fb7 req-4023b8fe-2df4-4e0b-8e67-14e3eeab6054 tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "cinder-5709e15e-070c-43c8-bdaf-bb8fa101b8e7-delete_snapshot" released by "delete_snapshot" :: held 3.218s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Acquiring lock "cinder-2d83adbd-eede-4dca-860a-d7f2212ac945-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "cinder-2d83adbd-eede-4dca-860a-d7f2212ac945-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Acquiring lock "cinder-quobyte-2d83adbd-eede-4dca-860a-d7f2212ac945" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "cinder-quobyte-2d83adbd-eede-4dca-860a-d7f2212ac945" acquired by "delete_volume" :: waited 0.072s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a0d7a7-0d83-4c47-8c55-b20d72cb7e97]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:33:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:54 devstack sudo[83741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 Apr 10 10:33:54 devstack sudo[83741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:56 devstack sudo[83741]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945" returned: 0 in 1.910s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:56 devstack sudo[83771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945 Apr 10 10:33:56 devstack sudo[83771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:58 devstack sudo[83771]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2d83adbd-eede-4dca-860a-d7f2212ac945" returned: 0 in 1.800s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:58 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "cinder-quobyte-2d83adbd-eede-4dca-860a-d7f2212ac945" released by "delete_volume" :: held 3.831s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:33:58 devstack cinder-volume[82038]: DEBUG cinder.quota [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Created reservations ['447e79e3-364a-4189-af80-5c919000eed4', 'd335754b-d056-44b1-99fa-5925edd763c4', '8a199216-c42a-4c23-9aee-901e76d20e9a', 'e495b08d-c21a-4bc7-88ac-28f66d75c11b'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:33:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:33:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:33:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:33:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:33:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:33:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:33:58 devstack sudo[83834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:33:58 devstack sudo[83834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:33:59 devstack sudo[83834]: pam_unix(sudo:session): session closed for user root Apr 10 10:33:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.746s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:33:59 devstack cinder-volume[82038]: DEBUG cinder.manager [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:33:59 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Deleted volume successfully. Apr 10 10:33:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-ea9daac1-6173-45aa-a2d4-dfbf23de8ecf req-ef3c8abe-5ddd-4e6f-a169-71c64d4f709e tempest-VolumesSnapshotsTestJSON-908917916 None] Lock "cinder-2d83adbd-eede-4dca-860a-d7f2212ac945-delete_volume" released by "delete_volume" :: held 4.915s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Flow 'volume_create_manager' (ef1ab4aa-4e86-44fd-93e1-2b1a18cb4acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a966f88f-8285-43f7-a375-9c8d6f51a1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a966f88f-8285-43f7-a375-9c8d6f51a1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1795525978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fc207b-e804-4d03-90dd-e77a9b186478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffe741e236d4409b1e1af10c0969bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:01Z,use_quota=True,user_id='5ad289cd9849409db9d480bd1f53eec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9311b13-4edf-4596-b5a3-f9c10928ba02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9311b13-4edf-4596-b5a3-f9c10928ba02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e5d528-0db7-4c0f-9087-4d938c38418a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2e5d528-0db7-4c0f-9087-4d938c38418a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46fc207b-e804-4d03-90dd-e77a9b186478', 'volume_name': 'volume-46fc207b-e804-4d03-90dd-e77a9b186478', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb033039-0956-4beb-bcef-2fec7b1ef6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb033039-0956-4beb-bcef-2fec7b1ef6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6ca13c-1560-4e4e-8c85-29974c5c7440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:00 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Volume 46fc207b-e804-4d03-90dd-e77a9b186478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46fc207b-e804-4d03-90dd-e77a9b186478', 'volume_size': 1} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1795525978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fc207b-e804-4d03-90dd-e77a9b186478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ffe741e236d4409b1e1af10c0969bd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:01Z,use_quota=True,user_id='5ad289cd9849409db9d480bd1f53eec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Creating volume 46fc207b-e804-4d03-90dd-e77a9b186478 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:00 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:34:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:00 devstack sudo[83838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478 1073741824 Apr 10 10:34:00 devstack sudo[83838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:02 devstack sudo[83838]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478 1073741824" returned: 0 in 1.980s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:02 devstack sudo[83844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478 Apr 10 10:34:02 devstack sudo[83844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:04 devstack sudo[83844]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478" returned: 0 in 1.283s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] <== create_volume: return (3368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.378s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af6ca13c-1560-4e4e-8c85-29974c5c7440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46fc207b-e804-4d03-90dd-e77a9b186478', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7183452c-7b14-42e8-ba83-0e0bc2561e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:04 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Volume volume-46fc207b-e804-4d03-90dd-e77a9b186478 (46fc207b-e804-4d03-90dd-e77a9b186478): created successfully Apr 10 10:34:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7183452c-7b14-42e8-ba83-0e0bc2561e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Flow 'volume_create_manager' (ef1ab4aa-4e86-44fd-93e1-2b1a18cb4acb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:04 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-2d610eaa-6bd0-4b89-8c8c-c8f4e8edcef7 tempest-VolumesAdminNegativeTest-370695026 None] Created volume successfully. Apr 10 10:34:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Acquiring lock "cinder-46fc207b-e804-4d03-90dd-e77a9b186478-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Lock "cinder-46fc207b-e804-4d03-90dd-e77a9b186478-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Acquiring lock "cinder-quobyte-46fc207b-e804-4d03-90dd-e77a9b186478" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Lock "cinder-quobyte-46fc207b-e804-4d03-90dd-e77a9b186478" acquired by "delete_volume" :: waited 0.022s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:06 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eecdb3f-96d5-4c4c-a62d-6629139a4183]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:06 devstack sudo[83850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478 Apr 10 10:34:06 devstack sudo[83850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:08 devstack sudo[83850]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478" returned: 0 in 1.833s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:08 devstack sudo[83879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478 Apr 10 10:34:08 devstack sudo[83879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:09 devstack sudo[83879]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-46fc207b-e804-4d03-90dd-e77a9b186478" returned: 0 in 1.695s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:09 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Lock "cinder-quobyte-46fc207b-e804-4d03-90dd-e77a9b186478" released by "delete_volume" :: held 3.634s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:09 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Created reservations ['d4240c9c-eff2-4ac3-99f2-ed4b4fe262bd', '09dfc64a-ed53-48c9-8ca6-b98be5f89d2b', '0ebe3e88-006e-42c4-bdce-d91dfed71bf6', 'e4bbc0c8-b1da-43e5-8663-ccc7db7b4ebc'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:10 devstack sudo[83890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:34:10 devstack sudo[83890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:11 devstack sudo[83890]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.227s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:11 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:11 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Deleted volume successfully. Apr 10 10:34:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1723b44e-c555-411d-a682-0734488528ae tempest-VolumesAdminNegativeTest-370695026 None] Lock "cinder-46fc207b-e804-4d03-90dd-e77a9b186478-delete_volume" released by "delete_volume" :: held 5.300s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Flow 'volume_create_manager' (b0a816c8-bdf7-481d-ad0f-fc0ac5ce5c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20d74fa-f271-4f5e-be8f-2773b6ff727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b20d74fa-f271-4f5e-be8f-2773b6ff727a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1732199145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5202501f-3c04-4978-9fbe-f340b8ee7878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79cc2cbfcb0455abb9ce2ddb5c10669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:16Z,use_quota=True,user_id='2d62e6886ee74a4cb6d1381f46f3d4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce57afa-246b-4f3c-b5fb-cc4b4e93ea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fce57afa-246b-4f3c-b5fb-cc4b4e93ea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d504d0-7342-44c2-bc4f-f0b7840374a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17d504d0-7342-44c2-bc4f-f0b7840374a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5202501f-3c04-4978-9fbe-f340b8ee7878', 'volume_name': 'volume-5202501f-3c04-4978-9fbe-f340b8ee7878', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221da576-bafd-4b0d-a51c-b594156bbff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (221da576-bafd-4b0d-a51c-b594156bbff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34485f3e-53b0-475c-a646-6e554e080806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:16 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Volume 5202501f-3c04-4978-9fbe-f340b8ee7878: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5202501f-3c04-4978-9fbe-f340b8ee7878', 'volume_size': 1} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1732199145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5202501f-3c04-4978-9fbe-f340b8ee7878,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f79cc2cbfcb0455abb9ce2ddb5c10669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:16Z,use_quota=True,user_id='2d62e6886ee74a4cb6d1381f46f3d4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Creating volume 5202501f-3c04-4978-9fbe-f340b8ee7878 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:16 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:34:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:16 devstack sudo[83956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878 1073741824 Apr 10 10:34:16 devstack sudo[83956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Flow 'volume_create_manager' (7a6a988c-772a-4252-8f08-2c460a418afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b964c7cf-11de-4e14-98a7-466a12b6bed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b964c7cf-11de-4e14-98a7-466a12b6bed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-134194452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51a24b8-6042-484b-bc44-905d20d8b7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd55711844142d5b322e0b3f17b18e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:18Z,use_quota=True,user_id='8f9f7019d0c3448a885eebe4190a58fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e2524d-77b8-44a8-b87f-7c2f8317cc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e2524d-77b8-44a8-b87f-7c2f8317cc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fa7660-5273-4596-8ecb-fd93f6ce4c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fa7660-5273-4596-8ecb-fd93f6ce4c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51a24b8-6042-484b-bc44-905d20d8b7e3', 'volume_name': 'volume-c51a24b8-6042-484b-bc44-905d20d8b7e3', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc82442-a84c-4052-a866-730b1ff378b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc82442-a84c-4052-a866-730b1ff378b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a7156b-d60f-4dcf-a89a-7a457725a265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:17 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Volume c51a24b8-6042-484b-bc44-905d20d8b7e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51a24b8-6042-484b-bc44-905d20d8b7e3', 'volume_size': 1} Apr 10 10:34:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:18 devstack sudo[83956]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878 1073741824" returned: 0 in 1.740s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:18 devstack sudo[83962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878 Apr 10 10:34:18 devstack sudo[83962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:18 devstack sudo[83962]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878" returned: 0 in 0.758s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] <== create_volume: return (2545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.548s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-134194452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51a24b8-6042-484b-bc44-905d20d8b7e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bd55711844142d5b322e0b3f17b18e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:18Z,use_quota=True,user_id='8f9f7019d0c3448a885eebe4190a58fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Creating volume c51a24b8-6042-484b-bc44-905d20d8b7e3 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:18 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34485f3e-53b0-475c-a646-6e554e080806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5202501f-3c04-4978-9fbe-f340b8ee7878', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a57905a-358b-499b-b0a3-cc23b37dfa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:18 devstack sudo[83965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3 1073741824 Apr 10 10:34:18 devstack sudo[83965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:18 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Volume volume-5202501f-3c04-4978-9fbe-f340b8ee7878 (5202501f-3c04-4978-9fbe-f340b8ee7878): created successfully Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a57905a-358b-499b-b0a3-cc23b37dfa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Flow 'volume_create_manager' (b0a816c8-bdf7-481d-ad0f-fc0ac5ce5c94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:18 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-9715a79a-5be4-4bf2-ae31-4d9b7188a446 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Created volume successfully. Apr 10 10:34:19 devstack sudo[83965]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3 1073741824" returned: 0 in 0.997s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:19 devstack sudo[83970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3 Apr 10 10:34:19 devstack sudo[83970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:20 devstack sudo[83970]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3" returned: 0 in 0.760s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98a7156b-d60f-4dcf-a89a-7a457725a265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51a24b8-6042-484b-bc44-905d20d8b7e3', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f6da5d-445b-4ffc-bb85-29051c4734dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:20 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Volume volume-c51a24b8-6042-484b-bc44-905d20d8b7e3 (c51a24b8-6042-484b-bc44-905d20d8b7e3): created successfully Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f6da5d-445b-4ffc-bb85-29051c4734dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Flow 'volume_create_manager' (7a6a988c-772a-4252-8f08-2c460a418afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:20 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-26b1fdf3-1ea6-4a95-a32f-f25076ff3f37 tempest-ServerRescueNegativeTestJSON-109440538 None] Created volume successfully. Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Acquiring lock "cinder-5202501f-3c04-4978-9fbe-f340b8ee7878-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Lock "cinder-5202501f-3c04-4978-9fbe-f340b8ee7878-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Acquiring lock "cinder-quobyte-5202501f-3c04-4978-9fbe-f340b8ee7878" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Lock "cinder-quobyte-5202501f-3c04-4978-9fbe-f340b8ee7878" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:21 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[96797b4c-8f93-4971-b582-c1ff07cf6f75]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:21 devstack sudo[83973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878 Apr 10 10:34:21 devstack sudo[83973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:22 devstack sudo[83973]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878" returned: 0 in 1.409s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:22 devstack sudo[83980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878 Apr 10 10:34:22 devstack sudo[83980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:23 devstack sudo[83980]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5202501f-3c04-4978-9fbe-f340b8ee7878" returned: 0 in 0.847s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Lock "cinder-quobyte-5202501f-3c04-4978-9fbe-f340b8ee7878" released by "delete_volume" :: held 2.384s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:23 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Created reservations ['c79b8638-4c08-492d-a1cf-86b813381e51', '17d67c03-d84f-4acc-a810-8f84818e45f2', '09dc1617-dd54-444f-b864-faf4e9bee834', 'e5c14ca9-f93d-4e8b-811c-f59e75bdfdeb'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:23 devstack sudo[83984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:34:23 devstack sudo[83984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:24 devstack sudo[83984]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.966s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:24 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:24 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Deleted volume successfully. Apr 10 10:34:24 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a62030d4-ed85-486f-9a13-394f748748a5 tempest-VolumeQuotasNegativeTestJSON-1177888693 None] Lock "cinder-5202501f-3c04-4978-9fbe-f340b8ee7878-delete_volume" released by "delete_volume" :: held 3.704s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:33 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:UPDATE=82,cinder:SELECT=63,cinder:INSERT=22,cinder:DELETE=4 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:34:34 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:UPDATE=59,cinder:SELECT=55,cinder:INSERT=10,cinder:DELETE=4 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:34:35 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Flow 'volume_create_manager' (4609a4ee-e805-43ca-8240-8544bae3d154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63adf289-f447-48d6-9a15-3510255cd8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63adf289-f447-48d6-9a15-3510255cd8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1831502610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc265dd-ae66-4f6b-8ae8-f2e640f95eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4609f5fc78a740c9a47e23eeab091cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:36Z,use_quota=True,user_id='7141e5ef2f7c44a4944980801ed67302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59aa257d-302d-4114-ad93-1c2f90458a60),volume_type_id=59aa257d-302d-4114-ad93-1c2f90458a60)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5beff697-b96e-42a9-8fdc-a5ee4e817682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5beff697-b96e-42a9-8fdc-a5ee4e817682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96422f36-c1ae-403c-9f8e-3650cf9b4677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96422f36-c1ae-403c-9f8e-3650cf9b4677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dc265dd-ae66-4f6b-8ae8-f2e640f95eba', 'volume_name': 'volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09cdd62-f3ed-4a86-aa1c-73f364aecbae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e09cdd62-f3ed-4a86-aa1c-73f364aecbae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc643c3a-9a6e-4867-b4fe-2e8247f366cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:36 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Volume 8dc265dd-ae66-4f6b-8ae8-f2e640f95eba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba', 'volume_size': 1} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1831502610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dc265dd-ae66-4f6b-8ae8-f2e640f95eba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4609f5fc78a740c9a47e23eeab091cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:36Z,use_quota=True,user_id='7141e5ef2f7c44a4944980801ed67302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59aa257d-302d-4114-ad93-1c2f90458a60),volume_type_id=59aa257d-302d-4114-ad93-1c2f90458a60)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Creating volume 8dc265dd-ae66-4f6b-8ae8-f2e640f95eba {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:36 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:34:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:36 devstack sudo[84053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba 1073741824 Apr 10 10:34:36 devstack sudo[84053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:37 devstack sudo[84053]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba 1073741824" returned: 0 in 1.239s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:37 devstack sudo[84080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba Apr 10 10:34:37 devstack sudo[84080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:38 devstack sudo[84080]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba" returned: 0 in 1.053s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:38 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] <== create_volume: return (2471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.475s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc643c3a-9a6e-4867-b4fe-2e8247f366cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f4f844-b2dc-435f-b800-a4a94881fb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:38 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Volume volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba (8dc265dd-ae66-4f6b-8ae8-f2e640f95eba): created successfully Apr 10 10:34:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f4f844-b2dc-435f-b800-a4a94881fb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Flow 'volume_create_manager' (4609a4ee-e805-43ca-8240-8544bae3d154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:38 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c38a1e34-5635-46df-8cc1-95282104c27f tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Created volume successfully. Apr 10 10:34:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:34:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:39 devstack sudo[84107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:34:39 devstack sudo[84107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d7f426f5-3844-4695-9977-221840b77435 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d7f426f5-3844-4695-9977-221840b77435 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d7f426f5-3844-4695-9977-221840b77435 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d7f426f5-3844-4695-9977-221840b77435 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d7f426f5-3844-4695-9977-221840b77435 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d7f426f5-3844-4695-9977-221840b77435 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:40 devstack sudo[84111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:34:40 devstack sudo[84111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Acquiring lock "cinder-c51a24b8-6042-484b-bc44-905d20d8b7e3-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Lock "cinder-c51a24b8-6042-484b-bc44-905d20d8b7e3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Acquiring lock "cinder-quobyte-c51a24b8-6042-484b-bc44-905d20d8b7e3" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Lock "cinder-quobyte-c51a24b8-6042-484b-bc44-905d20d8b7e3" acquired by "delete_volume" :: waited 0.039s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c09b1b-e70d-4de2-bd9d-ecda2c29890b]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:41 devstack sudo[84114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3 Apr 10 10:34:41 devstack sudo[84114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:41 devstack sudo[84107]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 2.479s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:41 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Acquiring lock "cinder-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "cinder-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Acquiring lock "cinder-quobyte-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:42 devstack sudo[84111]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d7f426f5-3844-4695-9977-221840b77435 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.838s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:42 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-d7f426f5-3844-4695-9977-221840b77435 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:42 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d7f426f5-3844-4695-9977-221840b77435 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Retype volume completed successfully. Apr 10 10:34:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "cinder-quobyte-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba" acquired by "delete_volume" :: waited 0.100s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:42 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7ced8f-e7d9-4a76-90cc-d92c0c31f061]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:42 devstack sudo[84120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba Apr 10 10:34:42 devstack sudo[84120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:43 devstack sudo[84114]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3" returned: 0 in 2.562s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:43 devstack sudo[84129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3 Apr 10 10:34:43 devstack sudo[84129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:44 devstack sudo[84120]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba" returned: 0 in 1.968s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Flow 'volume_create_manager' (ed1211d2-8990-41ec-827a-31646c5ab5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4d003a-6c62-4736-8066-0a827336f0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:44 devstack sudo[84135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba Apr 10 10:34:44 devstack sudo[84135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4d003a-6c62-4736-8066-0a827336f0c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1711028402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6a49a6-8467-4a5a-baf9-66549925c81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7442b85a0404d7790a829e61d86508c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:44Z,use_quota=True,user_id='cf458c44712f40929ceb9c8e99a9f406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79ea625-0872-45e9-acae-badefb52e40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b79ea625-0872-45e9-acae-badefb52e40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ff67a0-ce7a-412a-a0d3-8d0670049e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ff67a0-ce7a-412a-a0d3-8d0670049e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c6a49a6-8467-4a5a-baf9-66549925c81b', 'volume_name': 'volume-3c6a49a6-8467-4a5a-baf9-66549925c81b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9d6b65-74ee-447f-a6f1-9100e05706dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9d6b65-74ee-447f-a6f1-9100e05706dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89507989-8a5f-4eda-983d-3cc0a200dd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:44 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Volume 3c6a49a6-8467-4a5a-baf9-66549925c81b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c6a49a6-8467-4a5a-baf9-66549925c81b', 'volume_size': 1} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:34:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1711028402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6a49a6-8467-4a5a-baf9-66549925c81b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7442b85a0404d7790a829e61d86508c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:34:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:34:44Z,use_quota=True,user_id='cf458c44712f40929ceb9c8e99a9f406',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Creating volume 3c6a49a6-8467-4a5a-baf9-66549925c81b {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:34:44 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:34:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:44 devstack sudo[84137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b 1073741824 Apr 10 10:34:44 devstack sudo[84137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:45 devstack sudo[84129]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c51a24b8-6042-484b-bc44-905d20d8b7e3" returned: 0 in 1.694s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Lock "cinder-quobyte-c51a24b8-6042-484b-bc44-905d20d8b7e3" released by "delete_volume" :: held 4.311s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:45 devstack sudo[84135]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba" returned: 0 in 1.089s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Created reservations ['d0daf9bb-afb7-489a-aaad-e8b860fb8629', 'b9639e37-6aa9-47e7-ae24-b6812ea5a713', '8d329abf-7d46-4e47-95e9-a8e0faf4126c', '92285d79-809a-4b45-9247-ec17ea4ce67d'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "cinder-quobyte-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba" released by "delete_volume" :: held 3.142s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:45 devstack cinder-volume[82038]: WARNING cinder.quota [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:45 devstack cinder-volume[82038]: WARNING cinder.quota [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Created reservations ['81ae2cc0-e121-4a2a-998c-ac13a70b14b4', 'baf5ac0b-a7b7-4bfa-8d9c-339bf4b90848', 'e8c7405c-b6b5-4b84-adb2-7caa311c3205', '9a98898e-038c-4b42-a2e1-44fc56339441'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:45 devstack sudo[84150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:34:45 devstack sudo[84150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:45 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:34:45 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:46 devstack sudo[84137]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b 1073741824" returned: 0 in 1.817s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:46 devstack sudo[84154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b Apr 10 10:34:46 devstack sudo[84154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:46 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.359s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:46 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Deleted volume successfully. Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-43c2d05c-4380-434b-bc9a-1d4dec6d9c08 tempest-VolumeRetypeWithoutMigrationTest-1809826655 None] Lock "cinder-8dc265dd-ae66-4f6b-8ae8-f2e640f95eba-delete_volume" released by "delete_volume" :: held 5.227s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:47 devstack sudo[84150]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.858s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:34:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Deleted volume successfully. Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c83ba19a-a7d2-4610-b3d8-78c8e7bf0346 tempest-ServerRescueNegativeTestJSON-109440538 None] Lock "cinder-c51a24b8-6042-484b-bc44-905d20d8b7e3-delete_volume" released by "delete_volume" :: held 6.733s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:47 devstack sudo[84154]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b" returned: 0 in 1.593s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] <== create_volume: return (3534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.538s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89507989-8a5f-4eda-983d-3cc0a200dd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6a49a6-8467-4a5a-baf9-66549925c81b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d38641-f2a0-4943-8b89-fcc0dc4807f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:34:47 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Volume volume-3c6a49a6-8467-4a5a-baf9-66549925c81b (3c6a49a6-8467-4a5a-baf9-66549925c81b): created successfully Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31d38641-f2a0-4943-8b89-fcc0dc4807f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:34:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Flow 'volume_create_manager' (ed1211d2-8990-41ec-827a-31646c5ab5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:34:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c383c432-2d7a-41d5-99b9-489e5adb5700 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Created volume successfully. Apr 10 10:34:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:34:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:34:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Creating offline snapshot cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 of volume 3c6a49a6-8467-4a5a-baf9-66549925c81b {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:34:48 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6824395-98ff-4a4c-8adf-cee2421e27fe]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:49 devstack sudo[84192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b Apr 10 10:34:49 devstack sudo[84192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:49 devstack sudo[84192]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b" returned: 0 in 0.799s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:49 devstack sudo[84198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 1G Apr 10 10:34:49 devstack sudo[84198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:50 devstack sudo[84198]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 1G" returned: 0 in 1.010s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6a49a6-8467-4a5a-baf9-66549925c81b -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:50 devstack sudo[84203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6a49a6-8467-4a5a-baf9-66549925c81b -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 Apr 10 10:34:50 devstack sudo[84203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:51 devstack sudo[84203]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c6a49a6-8467-4a5a-baf9-66549925c81b -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4" returned: 0 in 0.882s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:51 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 is being set with open permissions: ugo+rw Apr 10 10:34:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:51 devstack sudo[84208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 Apr 10 10:34:51 devstack sudo[84208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:52 devstack sudo[84208]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4" returned: 0 in 0.836s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:52 devstack sudo[84212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.info Apr 10 10:34:52 devstack sudo[84212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:53 devstack sudo[84212]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.info" returned: 0 in 0.807s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:53 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.info is being set with open permissions: ugo+rw Apr 10 10:34:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:53 devstack sudo[84215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.info Apr 10 10:34:53 devstack sudo[84215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:54 devstack sudo[84215]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.info" returned: 0 in 1.154s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.604s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:34:54 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-5a113ffa-d363-42d0-96d2-784e078cc506 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Create snapshot completed successfully Apr 10 10:34:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Acquiring lock "cinder-cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "cinder-cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Acquiring lock "cinder-quobyte-3c6a49a6-8467-4a5a-baf9-66549925c81b" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "cinder-quobyte-3c6a49a6-8467-4a5a-baf9-66549925c81b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Acquiring lock "cinder-quobyte-cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "cinder-quobyte-cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Deleting offline snapshot cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 of volume 3c6a49a6-8467-4a5a-baf9-66549925c81b {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] snapshot_file for this snap is: volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d96777-a133-4694-a7d8-c420ad5165f2]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:56 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 Apr 10 10:34:56 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:56 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4" returned: 0 in 0.857s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c6a49a6-8467-4a5a-baf9-66549925c81b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66a14d5-2dc0-4b0f-8cf1-a2d1e0b7697e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:34:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:57 devstack sudo[84259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b Apr 10 10:34:57 devstack sudo[84259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:57 devstack sudo[84259]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b" returned: 0 in 0.843s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:57 devstack sudo[84264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 Apr 10 10:34:57 devstack sudo[84264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:58 devstack sudo[84264]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4" returned: 0 in 0.683s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:34:58 devstack sudo[84303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4 Apr 10 10:34:58 devstack sudo[84303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:34:59 devstack sudo[84303]: pam_unix(sudo:session): session closed for user root Apr 10 10:34:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b.cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4" returned: 0 in 0.705s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:34:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "cinder-quobyte-cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4" released by "_delete_snapshot" :: held 3.189s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "cinder-quobyte-3c6a49a6-8467-4a5a-baf9-66549925c81b" released by "delete_snapshot" :: held 3.206s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:34:59 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Created reservations ['58c8eb2d-e68d-4f2f-a70b-77d94a8d0fff', 'ebd935c0-e3f8-49a0-a563-3a7e20324f6d', 'c344431e-1a50-427f-9fdb-913c84dfbb88', '97f7e30e-f986-4c1d-a318-e0c25f17e92d'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:34:59 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Delete snapshot completed successfully. Apr 10 10:34:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-776af4ec-c305-4091-8dff-583ad819a724 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "cinder-cfd7e582-caa2-4c9a-9cee-3dfa8130c9c4-delete_snapshot" released by "delete_snapshot" :: held 3.345s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Acquiring lock "cinder-3c6a49a6-8467-4a5a-baf9-66549925c81b-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "cinder-3c6a49a6-8467-4a5a-baf9-66549925c81b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Flow 'volume_create_manager' (2a9c7a69-d795-4f87-9e0d-a24cd1507598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1010ba8e-7473-40eb-83d5-dd0ee8e39fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Acquiring lock "cinder-quobyte-3c6a49a6-8467-4a5a-baf9-66549925c81b" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1010ba8e-7473-40eb-83d5-dd0ee8e39fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1439537294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e310132-5271-47ee-9692-7fb0230e203c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a99d43a70f49468d76a4d1916fce98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:00Z,use_quota=True,user_id='b79050cd75a14ea2853cfdc5eb955d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8e5407-a8a2-42ef-9baa-1c19b84f528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8e5407-a8a2-42ef-9baa-1c19b84f528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928c1dda-9ef7-4d05-85a2-dac66a02f419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (928c1dda-9ef7-4d05-85a2-dac66a02f419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e310132-5271-47ee-9692-7fb0230e203c', 'volume_name': 'volume-9e310132-5271-47ee-9692-7fb0230e203c', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a63e7f0-10b6-4262-ad55-ba487a1c8819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a63e7f0-10b6-4262-ad55-ba487a1c8819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d545ee-ce06-4cec-875a-314297e6490f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:00 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Volume 9e310132-5271-47ee-9692-7fb0230e203c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e310132-5271-47ee-9692-7fb0230e203c', 'volume_size': 1} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1439537294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e310132-5271-47ee-9692-7fb0230e203c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a99d43a70f49468d76a4d1916fce98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:00Z,use_quota=True,user_id='b79050cd75a14ea2853cfdc5eb955d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Creating volume 9e310132-5271-47ee-9692-7fb0230e203c {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:00 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "cinder-quobyte-3c6a49a6-8467-4a5a-baf9-66549925c81b" acquired by "delete_volume" :: waited 0.078s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:00 devstack sudo[84307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c 1073741824 Apr 10 10:35:00 devstack sudo[84307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf61d2c-3294-4d30-94ec-9392b3dc8943]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:00 devstack sudo[84309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b Apr 10 10:35:00 devstack sudo[84309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:01 devstack sudo[84309]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b" returned: 0 in 0.676s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:01 devstack sudo[84317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b Apr 10 10:35:01 devstack sudo[84317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:01 devstack sudo[84307]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c 1073741824" returned: 0 in 0.774s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:01 devstack sudo[84319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c Apr 10 10:35:01 devstack sudo[84319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:01 devstack sudo[84317]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3c6a49a6-8467-4a5a-baf9-66549925c81b" returned: 0 in 0.689s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "cinder-quobyte-3c6a49a6-8467-4a5a-baf9-66549925c81b" released by "delete_volume" :: held 1.407s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Created reservations ['b0df0d57-c0b1-4e97-b4a6-f723de9c8216', '7221b367-37c6-47b9-bf7b-7c9dad0fafd2', '4ba371dd-e0c9-482e-a209-19fc725ff239', 'b019cf6f-f15d-4867-a0a1-46ac76ac3987'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:02 devstack sudo[84324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:02 devstack sudo[84324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:02 devstack sudo[84319]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c" returned: 0 in 0.987s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] <== create_volume: return (1847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d545ee-ce06-4cec-875a-314297e6490f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e310132-5271-47ee-9692-7fb0230e203c', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c4379d-c5e6-44ba-a3a1-1e616d8ebca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:02 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Volume volume-9e310132-5271-47ee-9692-7fb0230e203c (9e310132-5271-47ee-9692-7fb0230e203c): created successfully Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6c4379d-c5e6-44ba-a3a1-1e616d8ebca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Flow 'volume_create_manager' (2a9c7a69-d795-4f87-9e0d-a24cd1507598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:02 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-028c071a-a3fa-48b5-9225-61ca2f2684c5 tempest-VolumesListAdminTestJSON-477182300 None] Created volume successfully. Apr 10 10:35:02 devstack sudo[84324]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.834s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:02 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:03 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Deleted volume successfully. Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1cda57cc-08d7-474a-9953-2a3ec1c9f6a6 tempest-VolumeSnapshotQuotasNegativeTestJSON-438005498 None] Lock "cinder-3c6a49a6-8467-4a5a-baf9-66549925c81b-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Flow 'volume_create_manager' (1165bee3-003f-4674-83b0-f2962c29eafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7525054-1f17-43a1-a792-467b7b0741e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7525054-1f17-43a1-a792-467b7b0741e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1119321528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65422cf-0e3d-4a3e-95b3-8167895595d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a99d43a70f49468d76a4d1916fce98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:03Z,use_quota=True,user_id='b79050cd75a14ea2853cfdc5eb955d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c0b525-8cef-48c6-b994-9acfd4c2c789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c0b525-8cef-48c6-b994-9acfd4c2c789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ab7063-927d-4de3-acfe-958e62367ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ab7063-927d-4de3-acfe-958e62367ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65422cf-0e3d-4a3e-95b3-8167895595d6', 'volume_name': 'volume-b65422cf-0e3d-4a3e-95b3-8167895595d6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6f2583-9dee-4a56-8a1a-98a97ac13d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f6f2583-9dee-4a56-8a1a-98a97ac13d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1948881f-8e45-4444-8c98-0b7f80053239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:03 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Volume b65422cf-0e3d-4a3e-95b3-8167895595d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65422cf-0e3d-4a3e-95b3-8167895595d6', 'volume_size': 1} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1119321528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65422cf-0e3d-4a3e-95b3-8167895595d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a99d43a70f49468d76a4d1916fce98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:03Z,use_quota=True,user_id='b79050cd75a14ea2853cfdc5eb955d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Creating volume b65422cf-0e3d-4a3e-95b3-8167895595d6 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:03 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:03 devstack sudo[84329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6 1073741824 Apr 10 10:35:03 devstack sudo[84329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:04 devstack sudo[84329]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6 1073741824" returned: 0 in 0.900s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:04 devstack sudo[84335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6 Apr 10 10:35:04 devstack sudo[84335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:05 devstack sudo[84335]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6" returned: 0 in 0.675s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] <== create_volume: return (1643ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1948881f-8e45-4444-8c98-0b7f80053239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65422cf-0e3d-4a3e-95b3-8167895595d6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94e4d75-20e0-47ad-ac80-f99a6585443a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:05 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Volume volume-b65422cf-0e3d-4a3e-95b3-8167895595d6 (b65422cf-0e3d-4a3e-95b3-8167895595d6): created successfully Apr 10 10:35:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94e4d75-20e0-47ad-ac80-f99a6585443a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Flow 'volume_create_manager' (1165bee3-003f-4674-83b0-f2962c29eafe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:05 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a94d533c-7c16-4f2e-be66-d45b6bac92ab tempest-VolumesListAdminTestJSON-477182300 None] Created volume successfully. Apr 10 10:35:05 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Flow 'volume_create_manager' (27771630-66e3-45fe-a9ad-5b9510ab1579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14d5658-9843-4b98-99a8-d1cf45f91679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e14d5658-9843-4b98-99a8-d1cf45f91679) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-761418210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02450939-7407-4464-aea4-e458e6b83e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a99d43a70f49468d76a4d1916fce98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:06Z,use_quota=True,user_id='b79050cd75a14ea2853cfdc5eb955d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45eeb482-5613-4fd8-9720-67a236bf5e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45eeb482-5613-4fd8-9720-67a236bf5e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e3a703-830a-4a37-b2a1-97f738cddb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1e3a703-830a-4a37-b2a1-97f738cddb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02450939-7407-4464-aea4-e458e6b83e53', 'volume_name': 'volume-02450939-7407-4464-aea4-e458e6b83e53', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594ae803-e720-459e-b526-09b85b266daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (594ae803-e720-459e-b526-09b85b266daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c2f1e1-1e6a-4fe8-918a-8cb45e82d1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:06 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Volume 02450939-7407-4464-aea4-e458e6b83e53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02450939-7407-4464-aea4-e458e6b83e53', 'volume_size': 1} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-761418210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02450939-7407-4464-aea4-e458e6b83e53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e0a99d43a70f49468d76a4d1916fce98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:06Z,use_quota=True,user_id='b79050cd75a14ea2853cfdc5eb955d51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Creating volume 02450939-7407-4464-aea4-e458e6b83e53 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:06 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:06 devstack sudo[84339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53 1073741824 Apr 10 10:35:06 devstack sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:06 devstack sudo[84339]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53 1073741824" returned: 0 in 0.786s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:06 devstack sudo[84345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53 Apr 10 10:35:06 devstack sudo[84345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:07 devstack sudo[84345]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53" returned: 0 in 0.649s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23c2f1e1-1e6a-4fe8-918a-8cb45e82d1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02450939-7407-4464-aea4-e458e6b83e53', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb4220c-411f-4dd7-988f-3663b18f8241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:07 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Volume volume-02450939-7407-4464-aea4-e458e6b83e53 (02450939-7407-4464-aea4-e458e6b83e53): created successfully Apr 10 10:35:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eb4220c-411f-4dd7-988f-3663b18f8241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Flow 'volume_create_manager' (27771630-66e3-45fe-a9ad-5b9510ab1579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:07 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ff4c819e-052d-4769-854e-958008bd8053 tempest-VolumesListAdminTestJSON-477182300 None] Created volume successfully. Apr 10 10:35:08 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Flow 'volume_create_manager' (cdaaec3a-1b3c-45c7-a701-772cfaaec186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f26812-0c13-4df2-8a1a-13c123cce944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83f26812-0c13-4df2-8a1a-13c123cce944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea8d76e-1baa-4be8-b43d-647d670abce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0968ddea198d4d66ae84201e38af326b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:09Z,use_quota=True,user_id='8d9e789a7cb94ca4a42ddb9b0cef6cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6593369-e5be-4850-8d3d-8a53bc87e825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6593369-e5be-4850-8d3d-8a53bc87e825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a84df4-2cdf-4400-ae36-c0efe49093ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0a84df4-2cdf-4400-ae36-c0efe49093ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ea8d76e-1baa-4be8-b43d-647d670abce7', 'volume_name': 'volume-5ea8d76e-1baa-4be8-b43d-647d670abce7', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18830e1a-2d6a-457f-8ca7-19157b17cb81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18830e1a-2d6a-457f-8ca7-19157b17cb81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13e0d22-cbf8-43ee-ac33-8158886b1e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Volume 5ea8d76e-1baa-4be8-b43d-647d670abce7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ea8d76e-1baa-4be8-b43d-647d670abce7', 'volume_size': 1} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:09Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ea8d76e-1baa-4be8-b43d-647d670abce7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0968ddea198d4d66ae84201e38af326b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:09Z,use_quota=True,user_id='8d9e789a7cb94ca4a42ddb9b0cef6cc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Creating volume 5ea8d76e-1baa-4be8-b43d-647d670abce7 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:09 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:09 devstack sudo[84348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7 1073741824 Apr 10 10:35:09 devstack sudo[84348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Flow 'volume_create_manager' (3aeac60f-956a-4c73-ab4e-947c80a3a82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91dc432c-0230-4e20-823c-aace49845303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91dc432c-0230-4e20-823c-aace49845303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-844744645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2a5fd3-eeb1-4f76-8846-47cc0dc20346,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3d79daef18f40689f627da64fd36d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:10Z,use_quota=True,user_id='2521887bff2f4bcf83cd54d195796b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df2b2eb-2885-4389-b9dc-927918c51471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4df2b2eb-2885-4389-b9dc-927918c51471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d42be6c-e0be-4b64-a69d-565091ecfd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d42be6c-e0be-4b64-a69d-565091ecfd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e2a5fd3-eeb1-4f76-8846-47cc0dc20346', 'volume_name': 'volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e586f85a-06bf-45a3-a38b-988534d96ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e586f85a-06bf-45a3-a38b-988534d96ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d849a03-e1f9-4319-9d77-edf83dff44c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:09 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Volume 9e2a5fd3-eeb1-4f76-8846-47cc0dc20346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346', 'volume_size': 1} Apr 10 10:35:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:10 devstack sudo[84348]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7 1073741824" returned: 0 in 1.046s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:10 devstack sudo[84354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7 Apr 10 10:35:10 devstack sudo[84354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:10 devstack sudo[84354]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7" returned: 0 in 0.639s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.822s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-844744645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e2a5fd3-eeb1-4f76-8846-47cc0dc20346,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3d79daef18f40689f627da64fd36d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:10Z,use_quota=True,user_id='2521887bff2f4bcf83cd54d195796b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Creating volume 9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:10 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:10 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 1073741824 Apr 10 10:35:10 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f13e0d22-cbf8-43ee-ac33-8158886b1e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ea8d76e-1baa-4be8-b43d-647d670abce7', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3361d4d-2ee0-4d2a-b849-f67d8345ebc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:10 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Volume volume-5ea8d76e-1baa-4be8-b43d-647d670abce7 (5ea8d76e-1baa-4be8-b43d-647d670abce7): created successfully Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3361d4d-2ee0-4d2a-b849-f67d8345ebc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Flow 'volume_create_manager' (cdaaec3a-1b3c-45c7-a701-772cfaaec186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:10 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-37d236ad-9530-4fb1-b084-d155f0c8604e tempest-VolumesListAdminTestJSON-561864334 None] Created volume successfully. Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Acquiring lock "cinder-5ea8d76e-1baa-4be8-b43d-647d670abce7-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Lock "cinder-5ea8d76e-1baa-4be8-b43d-647d670abce7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Acquiring lock "cinder-quobyte-5ea8d76e-1baa-4be8-b43d-647d670abce7" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Lock "cinder-quobyte-5ea8d76e-1baa-4be8-b43d-647d670abce7" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2891c69c-02c4-4267-a4a2-b3980efb194f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:11 devstack sudo[84375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7 Apr 10 10:35:11 devstack sudo[84375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "cinder-02450939-7407-4464-aea4-e458e6b83e53-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-02450939-7407-4464-aea4-e458e6b83e53-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "cinder-quobyte-02450939-7407-4464-aea4-e458e6b83e53" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-quobyte-02450939-7407-4464-aea4-e458e6b83e53" acquired by "delete_volume" :: waited 0.020s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2c3b5f-eab8-4282-867c-fda3532abd9c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Flow 'volume_create_manager' (fbfb151e-9ca2-4f15-8584-b1ad8fe41432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:11 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53 Apr 10 10:35:11 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617ddf63-abea-49ab-87cc-2b8d9c59dd56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (617ddf63-abea-49ab-87cc-2b8d9c59dd56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-174237204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ac10ad-2970-4992-9cbd-e8e03032f967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd34bbcbd5ea46feb86f9d43de71ffec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:12Z,use_quota=True,user_id='6ca90e6fe6684144bde2921f1fa5348a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afb5ef2-a579-4901-ad9f-b6c4a85b6f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9afb5ef2-a579-4901-ad9f-b6c4a85b6f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569e135d-1186-4fc6-bcd0-1a22770ec91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG cinder.image.glance [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Creating Keystone auth plugin from conf {{(pid=82038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 1073741824" returned: 0 in 1.005s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:11 devstack sudo[84383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 Apr 10 10:35:11 devstack sudo[84383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (569e135d-1186-4fc6-bcd0-1a22770ec91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '23ac10ad-2970-4992-9cbd-e8e03032f967', 'volume_name': 'volume-23ac10ad-2970-4992-9cbd-e8e03032f967', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdd143c-5a4e-4c1b-80a3-ee6e93df0a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cdd143c-5a4e-4c1b-80a3-ee6e93df0a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30982385-ece2-46ad-a684-6995ef480aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:12 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Volume 23ac10ad-2970-4992-9cbd-e8e03032f967: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-23ac10ad-2970-4992-9cbd-e8e03032f967', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Trying to clone 23ac10ad-2970-4992-9cbd-e8e03032f967 from image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc at location (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]). {{(pid=82038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:35:12 devstack sudo[84375]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7" returned: 0 in 0.897s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:12 devstack sudo[84388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7 Apr 10 10:35:12 devstack sudo[84388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:35:12 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6d04fd-de02-4375-9c3f-40cceac29921]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:12 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53" returned: 0 in 0.763s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:12 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53 Apr 10 10:35:12 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:12 devstack sudo[84415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD Apr 10 10:35:12 devstack sudo[84415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:12 devstack sudo[84383]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346" returned: 0 in 0.644s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d849a03-e1f9-4319-9d77-edf83dff44c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf71191-d72b-4342-8de1-ee14bb7fd1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:12 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Volume volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 (9e2a5fd3-eeb1-4f76-8846-47cc0dc20346): created successfully Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf71191-d72b-4342-8de1-ee14bb7fd1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Flow 'volume_create_manager' (3aeac60f-956a-4c73-ab4e-947c80a3a82f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:12 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-32b4c439-2f46-49e3-8401-5d79b9e6ef52 tempest-VolumesTestJSON-1843156885 None] Created volume successfully. Apr 10 10:35:12 devstack sudo[84388]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5ea8d76e-1baa-4be8-b43d-647d670abce7" returned: 0 in 0.679s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Lock "cinder-quobyte-5ea8d76e-1baa-4be8-b43d-647d670abce7" released by "delete_volume" :: held 1.611s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:12 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Created reservations ['e245674e-4b74-4e7f-8284-6b5fa9ab69f8', '094c2ed9-3c06-4280-8fc7-c3ef64eb7fae', 'f98acd3c-0d31-49c4-9edb-2e244c53ec99', '6ac458b4-5859-4ac4-ad2a-db3f84d609de'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:13 devstack sudo[84423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:13 devstack sudo[84423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:13 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-02450939-7407-4464-aea4-e458e6b83e53" returned: 0 in 0.740s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-quobyte-02450939-7407-4464-aea4-e458e6b83e53" released by "delete_volume" :: held 1.542s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Created reservations ['8c5459a1-7a1b-4284-91e1-38da19c4b779', '78bb47ec-3e80-4f7f-b26e-490f30828b44', '9f02a968-7498-4b63-85d0-ef8d83eea495', '776c88d9-8327-4cec-91e3-bc8a2feeefa2'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:13 devstack sudo[84415]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD" returned: 0 in 0.880s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Temporary image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc is fetched for user 6ca90e6fe6684144bde2921f1fa5348a. {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdce8c0f-d921-4472-a480-6ad27b168c23]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:13 devstack sudo[84426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:13 devstack sudo[84426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:13 devstack sudo[84427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD Apr 10 10:35:13 devstack sudo[84427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Flow 'volume_create_manager' (f8b5a8a0-7690-48cc-83a4-1a0cc0680250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4fcd46-e32c-46af-a865-b3a6be232b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b4fcd46-e32c-46af-a865-b3a6be232b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2003860225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d263327b-9342-40d5-8528-0c2a087e916c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3d79daef18f40689f627da64fd36d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:14Z,use_quota=True,user_id='2521887bff2f4bcf83cd54d195796b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4f3516-a82e-4e23-85c0-91d27e45c8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4f3516-a82e-4e23-85c0-91d27e45c8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4dd428-74e1-4352-9bc6-6b6100e7796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4dd428-74e1-4352-9bc6-6b6100e7796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd263327b-9342-40d5-8528-0c2a087e916c', 'volume_name': 'volume-d263327b-9342-40d5-8528-0c2a087e916c', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c133e7b1-cf86-48a0-af89-ca5df117cec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c133e7b1-cf86-48a0-af89-ca5df117cec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99771f61-e4f7-47a6-bd4d-af85501b942f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:13 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Volume d263327b-9342-40d5-8528-0c2a087e916c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d263327b-9342-40d5-8528-0c2a087e916c', 'volume_size': 1} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2003860225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d263327b-9342-40d5-8528-0c2a087e916c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3d79daef18f40689f627da64fd36d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:14Z,use_quota=True,user_id='2521887bff2f4bcf83cd54d195796b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Creating volume d263327b-9342-40d5-8528-0c2a087e916c {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:13 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:13 devstack sudo[84430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c 1073741824 Apr 10 10:35:13 devstack sudo[84430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:13 devstack sudo[84423]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.747s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:13 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Deleted volume successfully. Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03afbdb4-ff8f-4406-80bd-a05f4af88bd5 tempest-VolumesListAdminTestJSON-561864334 None] Lock "cinder-5ea8d76e-1baa-4be8-b43d-647d670abce7-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "cinder-b65422cf-0e3d-4a3e-95b3-8167895595d6-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-b65422cf-0e3d-4a3e-95b3-8167895595d6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "cinder-quobyte-b65422cf-0e3d-4a3e-95b3-8167895595d6" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-quobyte-b65422cf-0e3d-4a3e-95b3-8167895595d6" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6857d1fa-773a-4b8c-90f2-485140266bc8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:14 devstack sudo[84426]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.716s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:14 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Deleted volume successfully. Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-96810f86-e197-4909-acd6-d5c51a7f8d99 tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-02450939-7407-4464-aea4-e458e6b83e53-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:14 devstack sudo[84437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6 Apr 10 10:35:14 devstack sudo[84437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:14 devstack sudo[84427]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD" returned: 0 in 0.779s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:14 devstack sudo[84430]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c 1073741824" returned: 0 in 0.753s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:14 devstack sudo[84445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c Apr 10 10:35:14 devstack sudo[84445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:14 devstack sudo[84437]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6" returned: 0 in 0.669s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:14 devstack sudo[84450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6 Apr 10 10:35:14 devstack sudo[84450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:14 devstack sudo[84445]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c" returned: 0 in 0.483s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.291s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.759s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-174237204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23ac10ad-2970-4992-9cbd-e8e03032f967,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd34bbcbd5ea46feb86f9d43de71ffec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:12Z,use_quota=True,user_id='6ca90e6fe6684144bde2921f1fa5348a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Creating volume 23ac10ad-2970-4992-9cbd-e8e03032f967 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:14 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:14 devstack sudo[84453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 1073741824 Apr 10 10:35:14 devstack sudo[84453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99771f61-e4f7-47a6-bd4d-af85501b942f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d263327b-9342-40d5-8528-0c2a087e916c', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11a0000-d590-402e-9af6-f156c9f71b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:14 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Volume volume-d263327b-9342-40d5-8528-0c2a087e916c (d263327b-9342-40d5-8528-0c2a087e916c): created successfully Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11a0000-d590-402e-9af6-f156c9f71b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Flow 'volume_create_manager' (f8b5a8a0-7690-48cc-83a4-1a0cc0680250) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:15 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-47ff1d59-40c7-4408-9012-cb90b9f61269 tempest-VolumesTestJSON-1843156885 None] Created volume successfully. Apr 10 10:35:15 devstack sudo[84450]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b65422cf-0e3d-4a3e-95b3-8167895595d6" returned: 0 in 0.529s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-quobyte-b65422cf-0e3d-4a3e-95b3-8167895595d6" released by "delete_volume" :: held 1.229s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Created reservations ['df098ead-cef6-4d33-895f-265f63b8825c', 'b3b7d34a-c510-4b56-8169-cf43b8f5df96', '626c9ddc-4dcd-4d20-892a-2a107fcf189b', '5460ed55-ed67-46bb-87ab-dcf44db463d0'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:15 devstack sudo[84459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:15 devstack sudo[84459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:15 devstack sudo[84453]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 1073741824" returned: 0 in 0.593s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:15 devstack sudo[84461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 Apr 10 10:35:15 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:15 devstack sudo[84459]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.652s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:16 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Deleted volume successfully. Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6aaf9ec-43b5-40b5-9234-68ba4618fb72 tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-b65422cf-0e3d-4a3e-95b3-8167895595d6-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:16 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Flow 'volume_create_manager' (6905be12-38dd-42fb-9ee2-7664b35e2eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ce36c7-bcdc-4ca3-9053-f8b1b102ad8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967" returned: 0 in 0.762s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5ce36c7-bcdc-4ca3-9053-f8b1b102ad8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-968843215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3d79daef18f40689f627da64fd36d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:16Z,use_quota=True,user_id='2521887bff2f4bcf83cd54d195796b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f0601f-cbb0-40b7-9e9d-6fa249dbddd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f0601f-cbb0-40b7-9e9d-6fa249dbddd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a223995-8ddf-4d82-a627-d433bf3feb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a223995-8ddf-4d82-a627-d433bf3feb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6', 'volume_name': 'volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3243122a-feb7-414e-b201-c01d8a211680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3243122a-feb7-414e-b201-c01d8a211680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b63bc11-6d17-4c86-8d7c-e08db2bd955a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:16 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Volume 9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6', 'volume_size': 1} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-968843215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f3d79daef18f40689f627da64fd36d4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:16Z,use_quota=True,user_id='2521887bff2f4bcf83cd54d195796b45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Creating volume 9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:16 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "cinder-9e310132-5271-47ee-9692-7fb0230e203c-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Attempting download of de7026ff-34c2-4bec-b6ea-0aa44cfce4dc ((None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}])) to volume 23ac10ad-2970-4992-9cbd-e8e03032f967. {{(pid=82038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-9e310132-5271-47ee-9692-7fb0230e203c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:16 devstack sudo[84490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 1073741824 Apr 10 10:35:16 devstack sudo[84490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "cinder-quobyte-9e310132-5271-47ee-9692-7fb0230e203c" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-quobyte-9e310132-5271-47ee-9692-7fb0230e203c" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[90209c89-e513-4235-beb7-9ab2f42f3d65]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93430ad-468f-4ff1-a4d0-e1f5a70f2373]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_yd84mwof {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:16 devstack sudo[84492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c Apr 10 10:35:16 devstack sudo[84492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:16 devstack sudo[84493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_yd84mwof Apr 10 10:35:16 devstack sudo[84493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:17 devstack sudo[84492]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c" returned: 0 in 0.926s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:17 devstack sudo[84493]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_yd84mwof" returned: 0 in 0.886s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_yd84mwof {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:17 devstack sudo[84505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c Apr 10 10:35:17 devstack sudo[84505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:17 devstack sudo[84490]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 1073741824" returned: 0 in 1.144s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:17 devstack sudo[84506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_yd84mwof Apr 10 10:35:17 devstack sudo[84506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:17 devstack sudo[84508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 Apr 10 10:35:17 devstack sudo[84508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:18 devstack sudo[84505]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e310132-5271-47ee-9692-7fb0230e203c" returned: 0 in 0.681s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-quobyte-9e310132-5271-47ee-9692-7fb0230e203c" released by "delete_volume" :: held 1.651s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Created reservations ['0cf429f0-87d6-4f95-80da-1de55c864908', 'e785ed98-6188-4838-9a31-2735a8cbc48f', '2d888567-46f4-45ac-aa28-67777068344a', '6ca04893-397b-4f82-872c-4513119c6b0e'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:18 devstack sudo[84506]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_yd84mwof" returned: 1 in 0.764s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_yd84mwof' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c92141-4818-4c61-a82e-194582684e91]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:18 devstack sudo[84508]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6" returned: 0 in 0.736s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b63bc11-6d17-4c86-8d7c-e08db2bd955a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5386ddf1-5251-4fa0-990c-81fc34bc0ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:18 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Volume volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 (9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6): created successfully Apr 10 10:35:18 devstack sudo[84515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD Apr 10 10:35:18 devstack sudo[84515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5386ddf1-5251-4fa0-990c-81fc34bc0ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Flow 'volume_create_manager' (6905be12-38dd-42fb-9ee2-7664b35e2eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:18 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a92a4aa2-2ddb-4a5c-8ca3-c815a4ac2362 tempest-VolumesTestJSON-1843156885 None] Created volume successfully. Apr 10 10:35:18 devstack sudo[84517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:18 devstack sudo[84517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:19 devstack sudo[84515]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD" returned: 0 in 1.175s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:19 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] de7026ff-34c2-4bec-b6ea-0aa44cfce4dc was qcow2, converting to raw {{(pid=82038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:35:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:19 devstack sudo[84523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 Apr 10 10:35:19 devstack sudo[84523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:19 devstack sudo[84517]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.197s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:19 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:19 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Deleted volume successfully. Apr 10 10:35:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-68b081b4-d751-47ad-a831-7cecca68696b tempest-VolumesListAdminTestJSON-477182300 None] Lock "cinder-9e310132-5271-47ee-9692-7fb0230e203c-delete_volume" released by "delete_volume" :: held 3.233s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "cinder-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Lock "cinder-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "cinder-quobyte-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Lock "cinder-quobyte-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:20 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[978fc01c-0645-40f0-b14b-613eeba88a01]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:21 devstack sudo[84531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 Apr 10 10:35:21 devstack sudo[84531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:21 devstack sudo[84523]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967" returned: 0 in 1.743s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:21 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_4hijkn2sdevstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:35:21 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Converted 112.00 MB image at 64.19 MB/s Apr 10 10:35:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:21 devstack sudo[84533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 1G Apr 10 10:35:21 devstack sudo[84533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:21 devstack sudo[84531]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6" returned: 0 in 0.843s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:21 devstack sudo[84538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6 Apr 10 10:35:21 devstack sudo[84538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:21 devstack sudo[84533]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 1G" returned: 0 in 0.763s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2956d811-82b1-4a53-be7b-f98a3cf586cb]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:22 devstack sudo[84544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 Apr 10 10:35:22 devstack sudo[84544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:22 devstack sudo[84538]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6" returned: 0 in 0.706s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Lock "cinder-quobyte-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6" released by "delete_volume" :: held 1.602s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Created reservations ['54c58ca4-97ac-4b78-8ad6-4a580cc292d2', '61c21f0c-bc1f-4120-ad19-c9d4e59f35d0', 'a1d44760-8f81-4bfb-83ba-93c8725fc968', '94521b30-e0c2-4fbd-8643-4f9e6f0b6767'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:22 devstack sudo[84547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:22 devstack sudo[84547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:22 devstack sudo[84544]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967" returned: 0 in 0.771s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:22 devstack sudo[84551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 Apr 10 10:35:22 devstack sudo[84551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "cinder-d263327b-9342-40d5-8528-0c2a087e916c-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Lock "cinder-d263327b-9342-40d5-8528-0c2a087e916c-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Flow 'volume_create_manager' (c372604b-62af-4745-bea3-2b06c1f3e974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468e24bc-7876-4e90-ad66-9f5c1bcd1c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "cinder-quobyte-d263327b-9342-40d5-8528-0c2a087e916c" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468e24bc-7876-4e90-ad66-9f5c1bcd1c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1868613281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990afe81-01f3-487d-b6cf-9b77f15a387f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c0f11b59e143d4bf4fcfd1939935fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:23Z,use_quota=True,user_id='a381e721d4cf4c14861a2225c8fbe77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ddaab4-16cd-4735-8558-ed741e9156f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42ddaab4-16cd-4735-8558-ed741e9156f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977b5bb1-e6c4-41a9-af7e-cf3c184a8405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (977b5bb1-e6c4-41a9-af7e-cf3c184a8405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990afe81-01f3-487d-b6cf-9b77f15a387f', 'volume_name': 'volume-990afe81-01f3-487d-b6cf-9b77f15a387f', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a776492f-35bd-45d7-84f4-e0709a0432de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a776492f-35bd-45d7-84f4-e0709a0432de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81776d9-9284-4b21-8bfc-d479e9450a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:23 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Volume 990afe81-01f3-487d-b6cf-9b77f15a387f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990afe81-01f3-487d-b6cf-9b77f15a387f', 'volume_size': 1} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1868613281',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990afe81-01f3-487d-b6cf-9b77f15a387f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4c0f11b59e143d4bf4fcfd1939935fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:23Z,use_quota=True,user_id='a381e721d4cf4c14861a2225c8fbe77d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Creating volume 990afe81-01f3-487d-b6cf-9b77f15a387f {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:23 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:23 devstack sudo[84547]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Lock "cinder-quobyte-d263327b-9342-40d5-8528-0c2a087e916c" acquired by "delete_volume" :: waited 0.068s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:23 devstack sudo[84558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f 1073741824 Apr 10 10:35:23 devstack sudo[84558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.722s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3decb26a-a670-45a4-9de4-5d6f89b7f2d3]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:23 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Deleted volume successfully. Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4076bf13-ec51-4518-925f-dd59273e2f35 tempest-VolumesTestJSON-1843156885 None] Lock "cinder-9ae1ea2a-6e8b-4a2d-9372-da2b63d390a6-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:23 devstack sudo[84562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c Apr 10 10:35:23 devstack sudo[84562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:23 devstack sudo[84551]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967" returned: 1 in 0.940s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Downloaded image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc ((None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}])) to volume 23ac10ad-2970-4992-9cbd-e8e03032f967 successfully. {{(pid=82038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Temporary image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc for user 6ca90e6fe6684144bde2921f1fa5348a is deleted. {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Marking volume 23ac10ad-2970-4992-9cbd-e8e03032f967 as bootable. {{(pid=82038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Copying metadata from image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc to 23ac10ad-2970-4992-9cbd-e8e03032f967. {{(pid=82038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Creating volume glance metadata for volume 23ac10ad-2970-4992-9cbd-e8e03032f967 backed by image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30982385-ece2-46ad-a684-6995ef480aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23ac10ad-2970-4992-9cbd-e8e03032f967', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04cabd7-6188-4d49-9674-f8d2d399e1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:23 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Volume volume-23ac10ad-2970-4992-9cbd-e8e03032f967 (23ac10ad-2970-4992-9cbd-e8e03032f967): created successfully Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f04cabd7-6188-4d49-9674-f8d2d399e1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Flow 'volume_create_manager' (fbfb151e-9ca2-4f15-8584-b1ad8fe41432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:23 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-cee04eba-7df1-4014-99a9-017502b07341 tempest-VolumesImageMetadata-1569320071 None] Created volume successfully. Apr 10 10:35:24 devstack sudo[84558]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f 1073741824" returned: 0 in 0.780s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:24 devstack sudo[84595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f Apr 10 10:35:24 devstack sudo[84595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:24 devstack sudo[84562]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c" returned: 0 in 0.847s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:24 devstack sudo[84597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c Apr 10 10:35:24 devstack sudo[84597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:24 devstack sudo[84597]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d263327b-9342-40d5-8528-0c2a087e916c" returned: 0 in 0.536s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:24 devstack sudo[84595]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Lock "cinder-quobyte-d263327b-9342-40d5-8528-0c2a087e916c" released by "delete_volume" :: held 1.439s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f" returned: 0 in 0.666s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81776d9-9284-4b21-8bfc-d479e9450a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990afe81-01f3-487d-b6cf-9b77f15a387f', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9433e0-306f-4ea4-be5d-20261b5d42dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:24 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Volume volume-990afe81-01f3-487d-b6cf-9b77f15a387f (990afe81-01f3-487d-b6cf-9b77f15a387f): created successfully Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9433e0-306f-4ea4-be5d-20261b5d42dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Flow 'volume_create_manager' (c372604b-62af-4745-bea3-2b06c1f3e974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:24 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-67b97bbb-957a-43cd-934c-428a11e71862 tempest-SnapshotMetadataTestJSON-325625789 None] Created volume successfully. Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Created reservations ['c18c2b19-a407-4d63-8c36-364d5423cc77', '1d6f650b-7b1a-49fa-bbd9-9e90c8246c9d', '9e1403ae-3ee2-4f76-8e52-d30dec6588f2', '7e6a3d8e-4bc9-4597-96cf-e9326d279c1b'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:24 devstack sudo[84601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:24 devstack sudo[84601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Acquiring lock "cinder-23ac10ad-2970-4992-9cbd-e8e03032f967-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Lock "cinder-23ac10ad-2970-4992-9cbd-e8e03032f967-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Acquiring lock "cinder-quobyte-23ac10ad-2970-4992-9cbd-e8e03032f967" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Lock "cinder-quobyte-23ac10ad-2970-4992-9cbd-e8e03032f967" acquired by "delete_volume" :: waited 0.017s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87e58fa-0a57-4bd9-8975-198babff0fe4]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Acquiring lock "cinder-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Lock "cinder-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:25 devstack sudo[84603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 Apr 10 10:35:25 devstack sudo[84603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Acquiring lock "cinder-quobyte-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Lock "cinder-quobyte-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346" acquired by "delete_volume" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Creating offline snapshot e6b2c148-519a-43d7-a4da-9554e2815361 of volume 990afe81-01f3-487d-b6cf-9b77f15a387f {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72e0d06-4192-4c69-aaa4-a92e3eadb10c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3baaa70-593a-4ccb-aac6-ee2b05e31ac5]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:25 devstack sudo[84607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 Apr 10 10:35:25 devstack sudo[84607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:25 devstack sudo[84608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f Apr 10 10:35:25 devstack sudo[84608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:25 devstack sudo[84601]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.975s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:25 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Deleted volume successfully. Apr 10 10:35:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-390364ba-cdd1-418a-bf13-98c217190298 tempest-VolumesTestJSON-1843156885 None] Lock "cinder-d263327b-9342-40d5-8528-0c2a087e916c-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:26 devstack sudo[84603]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967" returned: 0 in 0.939s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:26 devstack sudo[84617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 Apr 10 10:35:26 devstack sudo[84617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:26 devstack sudo[84607]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346" returned: 0 in 0.944s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:26 devstack sudo[84622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346 Apr 10 10:35:26 devstack sudo[84622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:26 devstack sudo[84608]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f" returned: 0 in 0.994s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:26 devstack sudo[84624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 1G Apr 10 10:35:26 devstack sudo[84624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:27 devstack sudo[84622]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346" returned: 0 in 0.588s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Lock "cinder-quobyte-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346" released by "delete_volume" :: held 1.573s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Created reservations ['165cdfd7-f43c-4210-8d50-339921be0311', 'cc04f419-3441-4774-83f1-5ee0ad11ad0a', '8470ee91-c57e-468c-a035-26ffd957ad3f', '8dbc16e4-8f04-4049-8fac-b8186f94e4d4'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:27 devstack sudo[84617]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967" returned: 1 in 0.952s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:27 devstack sudo[84633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967 Apr 10 10:35:27 devstack sudo[84633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:27 devstack sudo[84634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:27 devstack sudo[84634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:27 devstack sudo[84624]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 1G" returned: 0 in 0.996s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-990afe81-01f3-487d-b6cf-9b77f15a387f -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:27 devstack sudo[84637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-990afe81-01f3-487d-b6cf-9b77f15a387f -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 Apr 10 10:35:27 devstack sudo[84637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:27 devstack sudo[84634]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.565s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:27 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:27 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Deleted volume successfully. Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3052f69f-708d-4889-85ae-bc24799d3d3f tempest-VolumesTestJSON-1843156885 None] Lock "cinder-9e2a5fd3-eeb1-4f76-8846-47cc0dc20346-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:28 devstack sudo[84633]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-23ac10ad-2970-4992-9cbd-e8e03032f967" returned: 0 in 0.734s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Lock "cinder-quobyte-23ac10ad-2970-4992-9cbd-e8e03032f967" released by "delete_volume" :: held 2.704s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Created reservations ['8f33fd81-5402-497e-9386-11eeca764685', '61ce41ce-94ca-46a4-8d89-c62bed5b4e21', '1f5a7e3a-7c2e-47f6-a0c7-310016ed48c4', '6f3f90fd-ffba-4d54-b1b2-9e4710945fc8'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:28 devstack sudo[84641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:28 devstack sudo[84641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:28 devstack sudo[84637]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-990afe81-01f3-487d-b6cf-9b77f15a387f -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361" returned: 0 in 1.080s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:28 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 is being set with open permissions: ugo+rw Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:28 devstack sudo[84647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 Apr 10 10:35:28 devstack sudo[84647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:28 devstack sudo[84641]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.674s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:28 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Deleted volume successfully. Apr 10 10:35:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2f6b2999-56a7-4a66-8e7f-9c460cdfb431 tempest-VolumesImageMetadata-1569320071 None] Lock "cinder-23ac10ad-2970-4992-9cbd-e8e03032f967-delete_volume" released by "delete_volume" :: held 3.622s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:29 devstack sudo[84647]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361" returned: 0 in 0.794s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:29 devstack sudo[84650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.info Apr 10 10:35:29 devstack sudo[84650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:30 devstack sudo[84650]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.info" returned: 0 in 0.610s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:30 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.info is being set with open permissions: ugo+rw Apr 10 10:35:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:30 devstack sudo[84653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.info Apr 10 10:35:30 devstack sudo[84653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:30 devstack sudo[84653]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.info" returned: 0 in 0.663s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.263s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:30 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-bc3faaef-10a7-438a-8acd-e4522a8514f1 tempest-SnapshotMetadataTestJSON-325625789 None] Create snapshot completed successfully Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Flow 'volume_create_manager' (577c107c-2978-494c-bfce-8eb52a1d43be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76d4335-8298-42e3-ba17-3fc7a5bdb1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76d4335-8298-42e3-ba17-3fc7a5bdb1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-58884147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051abc31-3198-43d5-9816-aeb2cf5a32e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5018e116f38d45e2ba70a4a03bc01deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:32Z,use_quota=True,user_id='8443fd74a29a42e58aad8b59e195388b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a905a42e-8c68-4920-8ed9-5b6298c26eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a905a42e-8c68-4920-8ed9-5b6298c26eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b98ed1-f97a-482b-8e01-a75d76907d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11b98ed1-f97a-482b-8e01-a75d76907d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051abc31-3198-43d5-9816-aeb2cf5a32e9', 'volume_name': 'volume-051abc31-3198-43d5-9816-aeb2cf5a32e9', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c9b37a-1df7-4d2e-83d4-bf49bc674549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9c9b37a-1df7-4d2e-83d4-bf49bc674549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad66196c-af30-4b9d-9a50-a69018a42b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:32 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Volume 051abc31-3198-43d5-9816-aeb2cf5a32e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051abc31-3198-43d5-9816-aeb2cf5a32e9', 'volume_size': 1} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-58884147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051abc31-3198-43d5-9816-aeb2cf5a32e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5018e116f38d45e2ba70a4a03bc01deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:32Z,use_quota=True,user_id='8443fd74a29a42e58aad8b59e195388b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Creating volume 051abc31-3198-43d5-9816-aeb2cf5a32e9 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:32 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:32 devstack sudo[84657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 1073741824 Apr 10 10:35:32 devstack sudo[84657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Acquiring lock "cinder-e6b2c148-519a-43d7-a4da-9554e2815361-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "cinder-e6b2c148-519a-43d7-a4da-9554e2815361-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Acquiring lock "cinder-quobyte-990afe81-01f3-487d-b6cf-9b77f15a387f" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "cinder-quobyte-990afe81-01f3-487d-b6cf-9b77f15a387f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Acquiring lock "cinder-quobyte-e6b2c148-519a-43d7-a4da-9554e2815361" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "cinder-quobyte-e6b2c148-519a-43d7-a4da-9554e2815361" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Deleting offline snapshot e6b2c148-519a-43d7-a4da-9554e2815361 of volume 990afe81-01f3-487d-b6cf-9b77f15a387f {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] snapshot_file for this snap is: volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2fdc3eb-e32f-492a-a5aa-c4c10e0411be]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:33 devstack sudo[84659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 Apr 10 10:35:33 devstack sudo[84659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:33 devstack sudo[84657]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 1073741824" returned: 0 in 1.055s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:33 devstack sudo[84667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 Apr 10 10:35:33 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:33 devstack sudo[84659]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361" returned: 0 in 0.774s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-990afe81-01f3-487d-b6cf-9b77f15a387f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:33 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2275f21-a51c-4823-83c9-4f1568a046f8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:33 devstack sudo[84669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f Apr 10 10:35:33 devstack sudo[84669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:34 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9" returned: 0 in 0.662s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:34 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:UPDATE=141,cinder:SELECT=112,cinder:INSERT=33,cinder:DELETE=14 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:35:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad66196c-af30-4b9d-9a50-a69018a42b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051abc31-3198-43d5-9816-aeb2cf5a32e9', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5f9b22-b412-460a-82b1-60df7cf6c080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:34 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Volume volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 (051abc31-3198-43d5-9816-aeb2cf5a32e9): created successfully Apr 10 10:35:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5f9b22-b412-460a-82b1-60df7cf6c080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Flow 'volume_create_manager' (577c107c-2978-494c-bfce-8eb52a1d43be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:34 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f2127ca5-dff6-4775-948f-230c6a0719cf tempest-VolumesDeleteCascade-378882620 None] Created volume successfully. Apr 10 10:35:34 devstack sudo[84669]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f" returned: 0 in 0.810s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:34 devstack sudo[84675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 Apr 10 10:35:34 devstack sudo[84675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:35 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=101,cinder:UPDATE=136,cinder:INSERT=42,cinder:DELETE=11 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:35:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Creating offline snapshot a5d7e744-e176-452b-9cce-226d1a13a83e of volume 051abc31-3198-43d5-9816-aeb2cf5a32e9 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:35:35 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eb5206-221c-40b7-b9a2-3599861e5b5f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:35 devstack sudo[84678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 Apr 10 10:35:35 devstack sudo[84678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:35 devstack sudo[84675]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361" returned: 0 in 0.850s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:35 devstack sudo[84682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361 Apr 10 10:35:35 devstack sudo[84682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:36 devstack sudo[84678]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9" returned: 0 in 1.114s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:36 devstack sudo[84688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e 1G Apr 10 10:35:36 devstack sudo[84688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:36 devstack sudo[84682]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f.e6b2c148-519a-43d7-a4da-9554e2815361" returned: 0 in 0.881s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "cinder-quobyte-e6b2c148-519a-43d7-a4da-9554e2815361" released by "_delete_snapshot" :: held 3.440s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "cinder-quobyte-990afe81-01f3-487d-b6cf-9b77f15a387f" released by "delete_snapshot" :: held 3.463s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:36 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Created reservations ['5e21d195-1734-4008-8af8-f71038dececf', '4627b79c-b7dc-41be-bfa9-98d21ba411b6', '222db465-399b-44c6-8ab2-c528d56b4a45', '18c1c42f-2420-49c6-a2bd-92d6341089ce'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:36 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Delete snapshot completed successfully. Apr 10 10:35:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4d439d5-3306-4e9c-9d54-f63ef5ddc398 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "cinder-e6b2c148-519a-43d7-a4da-9554e2815361-delete_snapshot" released by "delete_snapshot" :: held 3.625s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:36 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-8151e813-fbb2-404e-a088-17ea526d83e6 tempest-GroupSnapshotsTest-1331356635 None] Group tempest-GroupSnapshotsTest-Group-1064345498: creating Apr 10 10:35:37 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-8151e813-fbb2-404e-a088-17ea526d83e6 tempest-GroupSnapshotsTest-1331356635 None] Group tempest-GroupSnapshotsTest-Group-1064345498: created successfully Apr 10 10:35:37 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-8151e813-fbb2-404e-a088-17ea526d83e6 tempest-GroupSnapshotsTest-1331356635 None] Create group completed successfully. Apr 10 10:35:37 devstack sudo[84688]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e 1G" returned: 0 in 0.922s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:37 devstack sudo[84694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e Apr 10 10:35:37 devstack sudo[84694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Acquiring lock "cinder-990afe81-01f3-487d-b6cf-9b77f15a387f-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "cinder-990afe81-01f3-487d-b6cf-9b77f15a387f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Acquiring lock "cinder-quobyte-990afe81-01f3-487d-b6cf-9b77f15a387f" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "cinder-quobyte-990afe81-01f3-487d-b6cf-9b77f15a387f" acquired by "delete_volume" :: waited 0.027s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9d7c54-99fa-4f45-a3f9-575bb8d23fc8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:37 devstack sudo[84696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f Apr 10 10:35:37 devstack sudo[84696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Flow 'volume_create_manager' (59091ac7-7041-47db-a74b-d724750a193b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fb1157-3967-4e22-8dd2-cc988baff514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07fb1157-3967-4e22-8dd2-cc988baff514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:38Z,deleted=False,deleted_at=None,display_description='',display_name='f12d0d09-5be2-4ade-9d7b-79cd9bde2a6e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a5aeb4-9e20-4100-b86d-5a47269ec3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b40e2b2a7ae401082d077a1bb578657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:38Z,use_quota=True,user_id='513ab4982f2d4cc79e318f1a49324a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99131605-4e3d-4ad7-a9ea-232406f1f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:37 devstack sudo[84694]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:37 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99131605-4e3d-4ad7-a9ea-232406f1f43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfd631e-92f8-4694-9318-0eca2a1163ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bfd631e-92f8-4694-9318-0eca2a1163ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52a5aeb4-9e20-4100-b86d-5a47269ec3a6', 'volume_name': 'volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f386e2f3-9b0c-47aa-b4ed-34558ee3394e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f386e2f3-9b0c-47aa-b4ed-34558ee3394e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2af949b-cacd-47ca-82aa-1bf869df1a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:38 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Volume 52a5aeb4-9e20-4100-b86d-5a47269ec3a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6', 'volume_size': 1} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e" returned: 0 in 0.895s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:38 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e is being set with open permissions: ugo+rw Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:38 devstack sudo[84701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e Apr 10 10:35:38 devstack sudo[84701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:38 devstack sudo[84696]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f" returned: 0 in 1.309s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:38 devstack sudo[84707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f Apr 10 10:35:38 devstack sudo[84707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Flow 'volume_create_manager' (9544d80f-5ab2-4d5f-81e1-477a404f95ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47bcf69-c74a-41bf-8c8b-dba37ea1bd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47bcf69-c74a-41bf-8c8b-dba37ea1bd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1222897146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b7babbf5-8659-40cd-acb7-40124ce9a09b,host='devstack@QuobyteHD#QuobyteHD',id=b2ac07e3-721f-4fb0-a666-2173b9f26784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7638ee663643909212284852fc7be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:39Z,use_quota=True,user_id='aa73d1f0c3e2491295df2570ca6d9fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59bc5305-e406-4350-8bb1-aa91524639c8),volume_type_id=59bc5305-e406-4350-8bb1-aa91524639c8)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c051c02d-afc4-4f7d-bb08-f45f95d9f6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c051c02d-afc4-4f7d-bb08-f45f95d9f6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d8b398-99db-4e27-9611-833345a0aa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d8b398-99db-4e27-9611-833345a0aa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2ac07e3-721f-4fb0-a666-2173b9f26784', 'volume_name': 'volume-b2ac07e3-721f-4fb0-a666-2173b9f26784', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92670a38-6301-4987-bfa6-bdfca23c8c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92670a38-6301-4987-bfa6-bdfca23c8c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:38 devstack sudo[84701]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718e7e3f-5041-46fa-a9fd-e236dc5f6dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:38 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Volume b2ac07e3-721f-4fb0-a666-2173b9f26784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2ac07e3-721f-4fb0-a666-2173b9f26784', 'volume_size': 1} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e" returned: 0 in 0.963s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:39 devstack sudo[84710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.info Apr 10 10:35:39 devstack sudo[84710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:39 devstack sudo[84713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:39 devstack sudo[84713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:39 devstack sudo[84707]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-990afe81-01f3-487d-b6cf-9b77f15a387f" returned: 0 in 0.607s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "cinder-quobyte-990afe81-01f3-487d-b6cf-9b77f15a387f" released by "delete_volume" :: held 1.980s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Created reservations ['6a227242-011c-4a42-abe2-d8a564220657', '67aca5f3-bb6a-4cba-93df-d7afa39bb91a', '0540eecf-ca36-4d32-8709-b0248cc8527a', '6b9f2e7c-1da4-4c54-bfd2-7cd3838a7819'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:39 devstack sudo[84717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:39 devstack sudo[84717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:39 devstack sudo[84710]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.info" returned: 0 in 0.625s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:39 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.info is being set with open permissions: ugo+rw Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:39 devstack sudo[84719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.info Apr 10 10:35:39 devstack sudo[84719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:39 devstack sudo[84713]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.680s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:39 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:40 devstack sudo[84717]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.733s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:40 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Deleted volume successfully. Apr 10 10:35:40 devstack sudo[84719]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1646db6-8c01-4e47-a62f-af5d6b6b4579 tempest-SnapshotMetadataTestJSON-325625789 None] Lock "cinder-990afe81-01f3-487d-b6cf-9b77f15a387f-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.info" returned: 0 in 0.650s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.261s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.293s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:38Z,deleted=False,deleted_at=None,display_description='',display_name='f12d0d09-5be2-4ade-9d7b-79cd9bde2a6e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52a5aeb4-9e20-4100-b86d-5a47269ec3a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b40e2b2a7ae401082d077a1bb578657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:38Z,use_quota=True,user_id='513ab4982f2d4cc79e318f1a49324a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Creating volume 52a5aeb4-9e20-4100-b86d-5a47269ec3a6 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:40 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:40 devstack sudo[84726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 1073741824 Apr 10 10:35:40 devstack sudo[84726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:40 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-1422bcfa-777a-4832-83f8-532cca7f1587 tempest-VolumesDeleteCascade-378882620 None] Create snapshot completed successfully Apr 10 10:35:41 devstack sudo[84726]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 1073741824" returned: 0 in 0.771s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:41 devstack sudo[84742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 Apr 10 10:35:41 devstack sudo[84742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:41 devstack sudo[84742]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6" returned: 0 in 0.733s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.881s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b7babbf5-8659-40cd-acb7-40124ce9a09b,created_at=2026-04-10T08:35:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1222897146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b7babbf5-8659-40cd-acb7-40124ce9a09b,host='devstack@QuobyteHD#QuobyteHD',id=b2ac07e3-721f-4fb0-a666-2173b9f26784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7638ee663643909212284852fc7be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:39Z,use_quota=True,user_id='aa73d1f0c3e2491295df2570ca6d9fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59bc5305-e406-4350-8bb1-aa91524639c8),volume_type_id=59bc5305-e406-4350-8bb1-aa91524639c8)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Creating volume b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:41 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2af949b-cacd-47ca-82aa-1bf869df1a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a9891c-beea-4ef3-8c8d-8795016436ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:41 devstack sudo[84746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 1073741824 Apr 10 10:35:41 devstack sudo[84746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:41 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Volume volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 (52a5aeb4-9e20-4100-b86d-5a47269ec3a6): created successfully Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10a9891c-beea-4ef3-8c8d-8795016436ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Flow 'volume_create_manager' (59091ac7-7041-47db-a74b-d724750a193b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:41 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-f716ea2d-d558-4bde-a192-cfdfd4a643d6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Created volume successfully. Apr 10 10:35:42 devstack sudo[84746]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 1073741824" returned: 0 in 0.694s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:42 devstack sudo[84751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 Apr 10 10:35:42 devstack sudo[84751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:43 devstack sudo[84751]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784" returned: 0 in 0.514s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.257s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.455s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (718e7e3f-5041-46fa-a9fd-e236dc5f6dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2ac07e3-721f-4fb0-a666-2173b9f26784', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c17e4df-1196-4f63-8288-4ca8c3ce90b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] Creating offline snapshot 2d15c718-2d07-42d2-bbcc-57da00ab793f of volume 051abc31-3198-43d5-9816-aeb2cf5a32e9 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:35:43 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Volume volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 (b2ac07e3-721f-4fb0-a666-2173b9f26784): created successfully Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c17e4df-1196-4f63-8288-4ca8c3ce90b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Flow 'volume_create_manager' (9544d80f-5ab2-4d5f-81e1-477a404f95ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbc81cb-f0a6-49f6-a462-2194131bc6e9]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:43 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e7b39d1f-3f58-42f1-89c0-b38bdc084bac tempest-GroupSnapshotsTest-1331356635 None] Created volume successfully. Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Flow 'volume_create_manager' (a172d646-6bd0-4499-bf95-257960de6524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e560dd0-ebb7-4134-9a5d-d7e8b9e254ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:43 devstack sudo[84754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e Apr 10 10:35:43 devstack sudo[84754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e560dd0-ebb7-4134-9a5d-d7e8b9e254ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1498920153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5823f325-1850-4eb4-b05d-715c3007e442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9995fdf2ab049809ea391e3d1a35ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:43Z,use_quota=True,user_id='8ecd1e27566e4fd1a54d488161e503db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22bc040-8483-46c3-8a97-35d3c5ac0420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c22bc040-8483-46c3-8a97-35d3c5ac0420) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42640e8-bfe6-494c-8f0e-255079841e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e42640e8-bfe6-494c-8f0e-255079841e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5823f325-1850-4eb4-b05d-715c3007e442', 'volume_name': 'volume-5823f325-1850-4eb4-b05d-715c3007e442', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb00da32-c2b8-4a0a-8b32-d01edd398a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb00da32-c2b8-4a0a-8b32-d01edd398a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c71f92a-adf6-4755-9a78-0bd077771312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:43 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Volume 5823f325-1850-4eb4-b05d-715c3007e442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5823f325-1850-4eb4-b05d-715c3007e442', 'volume_size': 1} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:43 devstack sudo[84754]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e" returned: 0 in 0.532s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051abc31-3198-43d5-9816-aeb2cf5a32e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:43 devstack sudo[84759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f 1G Apr 10 10:35:43 devstack sudo[84759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:44 devstack sudo[84759]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f 1G" returned: 0 in 0.756s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:44 devstack sudo[84772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f Apr 10 10:35:44 devstack sudo[84772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-ce895516-6949-4bd5-af63-d0d9be8eee5b tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] GroupSnapshot 4046cbab-6b49-4139-8bdb-e053faa21080: creating. Apr 10 10:35:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Group snapshot 4046cbab-6b49-4139-8bdb-e053faa21080: creating. {{(pid=82038) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:35:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:45 devstack sudo[84772]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f" returned: 0 in 0.602s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:45 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f is being set with open permissions: ugo+rw Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:45 devstack sudo[84777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f Apr 10 10:35:45 devstack sudo[84777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:45 devstack sudo[84777]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f" returned: 0 in 0.519s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.517s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.298s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1498920153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5823f325-1850-4eb4-b05d-715c3007e442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9995fdf2ab049809ea391e3d1a35ef3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:43Z,use_quota=True,user_id='8ecd1e27566e4fd1a54d488161e503db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Creating volume 5823f325-1850-4eb4-b05d-715c3007e442 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:45 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:45 devstack sudo[84780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442 1073741824 Apr 10 10:35:45 devstack sudo[84780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:45 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a671a39b-a4e7-4503-b3ee-04b54d7ed201 tempest-VolumesDeleteCascade-378882620 None] Create snapshot completed successfully Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-051abc31-3198-43d5-9816-aeb2cf5a32e9-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-051abc31-3198-43d5-9816-aeb2cf5a32e9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Performing cascade delete. {{(pid=82038) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-2d15c718-2d07-42d2-bbcc-57da00ab793f-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-2d15c718-2d07-42d2-bbcc-57da00ab793f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-051abc31-3198-43d5-9816-aeb2cf5a32e9" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-051abc31-3198-43d5-9816-aeb2cf5a32e9" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-2d15c718-2d07-42d2-bbcc-57da00ab793f" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-2d15c718-2d07-42d2-bbcc-57da00ab793f" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Deleting offline snapshot 2d15c718-2d07-42d2-bbcc-57da00ab793f of volume 051abc31-3198-43d5-9816-aeb2cf5a32e9 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] snapshot_file for this snap is: volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[696d3748-b28b-4d26-a425-8b5fadf9ac4e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:46 devstack sudo[84782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f Apr 10 10:35:46 devstack sudo[84782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:46 devstack sudo[84780]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442 1073741824" returned: 0 in 0.781s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:46 devstack sudo[84787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442 Apr 10 10:35:46 devstack sudo[84787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:46 devstack sudo[84782]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f" returned: 0 in 0.725s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051abc31-3198-43d5-9816-aeb2cf5a32e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3247056d-b00b-449c-887e-32df2a2704a2]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:46 devstack sudo[84792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e Apr 10 10:35:46 devstack sudo[84792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:47 devstack sudo[84787]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442" returned: 0 in 0.645s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] <== create_volume: return (1463ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-ce895516-6949-4bd5-af63-d0d9be8eee5b tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.484s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c71f92a-adf6-4755-9a78-0bd077771312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5823f325-1850-4eb4-b05d-715c3007e442', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2dc5d7b-525c-404c-9ad9-a157c61037aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[597f4e85-3587-4650-bbf6-14feee1d8668]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-ce895516-6949-4bd5-af63-d0d9be8eee5b tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:47 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Volume volume-5823f325-1850-4eb4-b05d-715c3007e442 (5823f325-1850-4eb4-b05d-715c3007e442): created successfully Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2dc5d7b-525c-404c-9ad9-a157c61037aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Flow 'volume_create_manager' (a172d646-6bd0-4499-bf95-257960de6524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b0675aba-7df5-4b55-aeb2-981496cadbcc tempest-VolumesMetadataTest-1028701462 None] Created volume successfully. Apr 10 10:35:47 devstack sudo[84795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 Apr 10 10:35:47 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:47 devstack sudo[84792]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e" returned: 0 in 0.702s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051abc31-3198-43d5-9816-aeb2cf5a32e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:47 devstack sudo[84806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f Apr 10 10:35:47 devstack sudo[84806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:47 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-ce895516-6949-4bd5-af63-d0d9be8eee5b tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6" returned: 0 in 0.773s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-de881a71-2725-4830-acfd-be7b25119ac4 req-ce895516-6949-4bd5-af63-d0d9be8eee5b tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.799s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.174s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Creating offline snapshot 3d1a941e-3037-432f-ac48-8750564cbd01 of volume b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5c9ebd-02e0-4e50-ba44-1a545d89b4bf]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-ce895516-6949-4bd5-af63-d0d9be8eee5b tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e', 'name': 'volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2a067ef-fcd8-4696-9a53-2bde19f7d1f0', 'enforce_multipath': True} {{(pid=82038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 10:35:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-de881a71-2725-4830-acfd-be7b25119ac4 req-ce895516-6949-4bd5-af63-d0d9be8eee5b tempest-ServerBootFromVolumeStableRescueTest-835379547 None] attachment_update completed successfully. Apr 10 10:35:48 devstack sudo[84811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 Apr 10 10:35:48 devstack sudo[84811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:48 devstack sudo[84806]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f" returned: 0 in 0.836s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:48 devstack sudo[84816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f Apr 10 10:35:48 devstack sudo[84816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Acquiring lock "cinder-5823f325-1850-4eb4-b05d-715c3007e442-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Lock "cinder-5823f325-1850-4eb4-b05d-715c3007e442-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Acquiring lock "cinder-quobyte-5823f325-1850-4eb4-b05d-715c3007e442" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Lock "cinder-quobyte-5823f325-1850-4eb4-b05d-715c3007e442" acquired by "delete_volume" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a746a2-25d5-4985-a5c6-1cbe7f5c4f27]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:48 devstack sudo[84818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442 Apr 10 10:35:48 devstack sudo[84818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:48 devstack sudo[84811]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784" returned: 0 in 0.882s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:48 devstack sudo[84823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 1G Apr 10 10:35:48 devstack sudo[84823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:49 devstack sudo[84816]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.2d15c718-2d07-42d2-bbcc-57da00ab793f" returned: 0 in 0.849s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-2d15c718-2d07-42d2-bbcc-57da00ab793f" released by "_delete_snapshot" :: held 3.178s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-051abc31-3198-43d5-9816-aeb2cf5a32e9" released by "delete_snapshot" :: held 3.194s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Created reservations ['846a9ec4-a9d5-48e2-b99d-b6c49992c531', '10c90e43-81d8-4786-81d2-85e40119e284', 'e4fb279b-d581-494a-85f5-d32e89d90cc1', '40bc58c5-932d-4b65-990f-554816b0faec'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:49 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Delete snapshot completed successfully. Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-2d15c718-2d07-42d2-bbcc-57da00ab793f-delete_snapshot" released by "delete_snapshot" :: held 3.358s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-a5d7e744-e176-452b-9cce-226d1a13a83e-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-a5d7e744-e176-452b-9cce-226d1a13a83e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-051abc31-3198-43d5-9816-aeb2cf5a32e9" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-051abc31-3198-43d5-9816-aeb2cf5a32e9" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-a5d7e744-e176-452b-9cce-226d1a13a83e" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:49 devstack sudo[84818]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442" returned: 0 in 0.805s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-a5d7e744-e176-452b-9cce-226d1a13a83e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Deleting offline snapshot a5d7e744-e176-452b-9cce-226d1a13a83e of volume 051abc31-3198-43d5-9816-aeb2cf5a32e9 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] snapshot_file for this snap is: volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce26ae4-9de7-464f-8b82-55c8e0c126d0]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:49 devstack sudo[84832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442 Apr 10 10:35:49 devstack sudo[84832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:49 devstack sudo[84833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e Apr 10 10:35:49 devstack sudo[84833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:49 devstack sudo[84823]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 1G" returned: 0 in 0.776s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:49 devstack sudo[84836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 Apr 10 10:35:49 devstack sudo[84836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:50 devstack sudo[84832]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-5823f325-1850-4eb4-b05d-715c3007e442" returned: 0 in 0.743s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Lock "cinder-quobyte-5823f325-1850-4eb4-b05d-715c3007e442" released by "delete_volume" :: held 1.601s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:50 devstack sudo[84833]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e" returned: 0 in 0.817s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-051abc31-3198-43d5-9816-aeb2cf5a32e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Created reservations ['1287bac6-6f98-4745-a654-d882cf09bf64', '825609ab-9bd8-4ed9-8ffc-f1e4dc036062', '4317f1da-f901-45e1-bc5c-2119c334423f', '4f4d0009-bc7e-4b27-a36e-5f087ddcb28f'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[723638f3-5a9c-40f5-ab0e-3391e24930d3]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:50 devstack sudo[84836]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01" returned: 0 in 0.824s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:50 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:35:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:50 devstack sudo[84912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 Apr 10 10:35:50 devstack sudo[84912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:50 devstack sudo[84913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:50 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:50 devstack sudo[84914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 Apr 10 10:35:50 devstack sudo[84914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:51 devstack sudo[84914]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01" returned: 0 in 0.709s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:51 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.781s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:51 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:51 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Deleted volume successfully. Apr 10 10:35:51 devstack sudo[84926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.info Apr 10 10:35:51 devstack sudo[84926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-47d3762a-e140-4345-b493-1ef52402ecbe tempest-VolumesMetadataTest-1028701462 None] Lock "cinder-5823f325-1850-4eb4-b05d-715c3007e442-delete_volume" released by "delete_volume" :: held 2.739s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:51 devstack sudo[84912]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9" returned: 0 in 1.203s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:51 devstack sudo[84934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e Apr 10 10:35:51 devstack sudo[84934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:52 devstack sudo[84926]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.info" returned: 0 in 1.050s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:52 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:35:52 devstack sudo[84934]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e" returned: 0 in 0.735s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:52 devstack sudo[84942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.info Apr 10 10:35:52 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:52 devstack sudo[84943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e Apr 10 10:35:52 devstack sudo[84943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:52 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.info" returned: 0 in 0.554s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.896s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:53 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-030e739a-2c43-48ee-b9cb-53eb4a26c573 tempest-GroupSnapshotsTest-1331356635 None] group_snapshot 4046cbab-6b49-4139-8bdb-e053faa21080: created successfully Apr 10 10:35:53 devstack sudo[84943]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9.a5d7e744-e176-452b-9cce-226d1a13a83e" returned: 0 in 0.761s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-a5d7e744-e176-452b-9cce-226d1a13a83e" released by "_delete_snapshot" :: held 3.619s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-051abc31-3198-43d5-9816-aeb2cf5a32e9" released by "delete_snapshot" :: held 3.641s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:53 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Created reservations ['e68486db-a600-4d09-9599-9cf2351cc36f', 'a7a26b39-ee40-49d1-918f-bf81b38a8ef7', '8f03ee96-75ac-436a-b4e1-edc38e055253', 'de3da0de-b413-40c0-9a29-1b43ad5345a7'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:53 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Delete snapshot completed successfully. Apr 10 10:35:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-a5d7e744-e176-452b-9cce-226d1a13a83e-delete_snapshot" released by "delete_snapshot" :: held 3.913s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:53 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Snapshots deleted, issuing volume delete {{(pid=82038) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 10:35:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-051abc31-3198-43d5-9816-aeb2cf5a32e9" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-051abc31-3198-43d5-9816-aeb2cf5a32e9" acquired by "delete_volume" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbf5044-ce72-4bf4-9a30-fc3c1c548994]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:53 devstack sudo[85283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 Apr 10 10:35:53 devstack sudo[85283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:54 devstack sudo[85283]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9" returned: 0 in 0.802s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:54 devstack sudo[85290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9 Apr 10 10:35:54 devstack sudo[85290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Flow 'volume_create_manager' (c12a040c-b336-4451-bc70-6286a33c4c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b678c97-2855-404e-bbe1-e7e670a3bca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b678c97-2855-404e-bbe1-e7e670a3bca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-889614839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6edd40d82b4eb38e36f030f003bd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:54Z,use_quota=True,user_id='a9a9f42751a14ea6843d415f71adc9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24c0e0f-8aec-472a-933e-cef817a14431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e24c0e0f-8aec-472a-933e-cef817a14431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fa2555-a498-4d79-93fc-aa081cccbff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4fa2555-a498-4d79-93fc-aa081cccbff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7', 'volume_name': 'volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58aa14f5-cc93-4f3b-bb88-f6b46f950f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58aa14f5-cc93-4f3b-bb88-f6b46f950f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e9b3fc-b7ad-45e0-90b9-64d82ee5eb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:54 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Volume 1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7', 'volume_size': 1} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-889614839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6edd40d82b4eb38e36f030f003bd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:54Z,use_quota=True,user_id='a9a9f42751a14ea6843d415f71adc9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Creating volume 1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:54 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:54 devstack sudo[85292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 1073741824 Apr 10 10:35:54 devstack sudo[85292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:54 devstack sudo[85290]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051abc31-3198-43d5-9816-aeb2cf5a32e9" returned: 0 in 0.623s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-051abc31-3198-43d5-9816-aeb2cf5a32e9" released by "delete_volume" :: held 1.499s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Created reservations ['50dbd8d6-3946-4b6c-bec0-364d706c6650', '7383d223-8b60-4f59-b47f-ee7876df64b9', 'df182d3e-8944-4c48-a9d8-cb5655ffc119', '09f04057-fd56-4eac-a0e8-e35df3b316f1'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:54 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:35:54 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:55 devstack sudo[85292]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 1073741824" returned: 0 in 0.727s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:55 devstack sudo[85300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 Apr 10 10:35:55 devstack sudo[85300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:55 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.563s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:35:55 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Deleted volume successfully. Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ddd375cf-27e7-4cff-9693-3b0704234d94 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-051abc31-3198-43d5-9816-aeb2cf5a32e9-delete_volume" released by "delete_volume" :: held 9.572s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:35:55 devstack sudo[85300]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Flow 'volume_create_manager' (6625bf9b-94dc-4101-8d6d-f844fbc74797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba42c006-ea9c-47d0-8aeb-1a99b57d2a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba42c006-ea9c-47d0-8aeb-1a99b57d2a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1609266725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c95de3-5836-445b-8ca0-561a8fda9cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5018e116f38d45e2ba70a4a03bc01deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:56Z,use_quota=True,user_id='8443fd74a29a42e58aad8b59e195388b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b56d14-52a6-43de-b770-d41e4d143eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b56d14-52a6-43de-b770-d41e4d143eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17d3608-6a20-46e9-a46e-97b974036d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b17d3608-6a20-46e9-a46e-97b974036d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7c95de3-5836-445b-8ca0-561a8fda9cc0', 'volume_name': 'volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef30b92-3df8-4747-b816-f297e73782a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef30b92-3df8-4747-b816-f297e73782a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe922228-7851-474b-8788-de3b0845a4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:55 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Volume f7c95de3-5836-445b-8ca0-561a8fda9cc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0', 'volume_size': 1} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7" returned: 0 in 0.639s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.197s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-3d1a941e-3037-432f-ac48-8750564cbd01-131c6a76-8aff-407c-a441-cedefadeaff0" by "_create_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65e9b3fc-b7ad-45e0-90b9-64d82ee5eb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22835d64-98b8-459f-b19c-dd4ac7602dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-3d1a941e-3037-432f-ac48-8750564cbd01-131c6a76-8aff-407c-a441-cedefadeaff0" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Creating volume 131c6a76-8aff-407c-a441-cedefadeaff0 from snapshot 3d1a941e-3037-432f-ac48-8750564cbd01 {{(pid=82038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-131c6a76-8aff-407c-a441-cedefadeaff0" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:35:55 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Volume volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 (1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7): created successfully Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22835d64-98b8-459f-b19c-dd4ac7602dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Flow 'volume_create_manager' (c12a040c-b336-4451-bc70-6286a33c4c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-131c6a76-8aff-407c-a441-cedefadeaff0" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] snapshot: 3d1a941e-3037-432f-ac48-8750564cbd01, volume: 131c6a76-8aff-407c-a441-cedefadeaff0, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:35:55 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-10e90672-4da7-453f-acea-95460cbc48e2 tempest-VolumesCloneTest-216933986 None] Created volume successfully. Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4c00d8-2aa1-4e9c-a194-6e804217c0b5]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:55 devstack sudo[85304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 Apr 10 10:35:55 devstack sudo[85304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:56 devstack sudo[85304]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01" returned: 0 in 0.665s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ac07e3-721f-4fb0-a666-2173b9f26784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7f9b74-cc27-4cd8-ab18-6f07cd92c204]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:56 devstack sudo[85309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 Apr 10 10:35:56 devstack sudo[85309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Flow 'volume_create_manager' (58850fcf-7046-4325-aac2-2846d88a637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8b2224-8ef5-47d0-9dbd-603215f5ee93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc8b2224-8ef5-47d0-9dbd-603215f5ee93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-371612280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=236ea7c7-6a79-4ff6-b223-1d69cf20ae80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6edd40d82b4eb38e36f030f003bd7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:57Z,use_quota=True,user_id='a9a9f42751a14ea6843d415f71adc9d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cfe2b4-f5ea-4654-b260-d6ec5d87c6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01cfe2b4-f5ea-4654-b260-d6ec5d87c6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d38ddcc-ec55-4f84-aa85-26c4aa127bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d38ddcc-ec55-4f84-aa85-26c4aa127bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '236ea7c7-6a79-4ff6-b223-1d69cf20ae80', 'volume_name': 'volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80', 'volume_size': 2, 'source_volid': '1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7', 'source_volstatus': 'available'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e219e89d-6eaf-4f53-a712-393cbb66bf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e219e89d-6eaf-4f53-a712-393cbb66bf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb243f45-21d4-4792-98ba-a707ea5b3a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:35:56 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Volume 236ea7c7-6a79-4ff6-b223-1d69cf20ae80: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80', 'volume_size': 2, 'source_volid': '1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7', 'source_volstatus': 'available'} Apr 10 10:35:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:35:57 devstack sudo[85309]: pam_unix(sudo:session): session closed for user root Apr 10 10:35:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784" returned: 0 in 0.674s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:35:57 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:35:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:35:57 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 Apr 10 10:35:57 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:00 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0" returned: 0 in 3.354s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:00 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[121773f8-6d4d-4d0b-8ff4-f7c138f2d881]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:00 devstack sudo[85361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 Apr 10 10:36:00 devstack sudo[85361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:01 devstack sudo[85361]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784" returned: 0 in 0.700s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784, size 1024.00 MB, duration 3.36 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:01 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Converted 1024.00 MB image at 305.17 MB/s Apr 10 10:36:01 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:01 devstack sudo[85366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 Apr 10 10:36:01 devstack sudo[85366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:01 devstack sudo[85366]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0" returned: 0 in 0.607s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-131c6a76-8aff-407c-a441-cedefadeaff0" released by "_copy_volume_from_snapshot" :: held 6.085s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-3d1a941e-3037-432f-ac48-8750564cbd01-131c6a76-8aff-407c-a441-cedefadeaff0" released by "_create_volume_from_snapshot" :: held 6.122s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.150s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.162s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:35:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1609266725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c95de3-5836-445b-8ca0-561a8fda9cc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5018e116f38d45e2ba70a4a03bc01deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:35:56Z,use_quota=True,user_id='8443fd74a29a42e58aad8b59e195388b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Creating volume f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:01 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:36:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:01 devstack sudo[85392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 1073741824 Apr 10 10:36:01 devstack sudo[85392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:02 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-611abfc8-895d-4e81-bd3a-fa09f592142a tempest-GroupSnapshotsTest-1331356635 None] Create group from source-snapshot-4046cbab-6b49-4139-8bdb-e053faa21080 completed successfully. Apr 10 10:36:02 devstack sudo[85392]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 1073741824" returned: 0 in 0.712s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:02 devstack sudo[85400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 Apr 10 10:36:02 devstack sudo[85400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-131c6a76-8aff-407c-a441-cedefadeaff0" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-131c6a76-8aff-407c-a441-cedefadeaff0" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:02 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[40622206-40c0-4c78-9c84-17373995e257]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:02 devstack sudo[85402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 Apr 10 10:36:02 devstack sudo[85402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:03 devstack sudo[85400]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0" returned: 0 in 0.592s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.348s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.337s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:03 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Cloning volume 1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 to volume 236ea7c7-6a79-4ff6-b223-1d69cf20ae80 Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe922228-7851-474b-8788-de3b0845a4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc414351-8cb5-4124-83cb-11ad0f2f8e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:03 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Volume volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 (f7c95de3-5836-445b-8ca0-561a8fda9cc0): created successfully Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc414351-8cb5-4124-83cb-11ad0f2f8e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Flow 'volume_create_manager' (6625bf9b-94dc-4101-8d6d-f844fbc74797) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Creating offline snapshot 3fe78258-8bef-40f1-a807-f548819a167a of volume 1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:03 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-afbee9a4-cb71-42ec-98a9-c6bbdfa3c5bb tempest-VolumesDeleteCascade-378882620 None] Created volume successfully. Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b49c787-50c7-41e1-8d44-876f3611afae]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:03 devstack sudo[85411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 Apr 10 10:36:03 devstack sudo[85411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:03 devstack sudo[85402]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0" returned: 0 in 0.660s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:03 devstack sudo[85415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0 Apr 10 10:36:03 devstack sudo[85415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:04 devstack sudo[85411]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7" returned: 0 in 0.685s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:04 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a 1G Apr 10 10:36:04 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:04 devstack sudo[85415]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-131c6a76-8aff-407c-a441-cedefadeaff0" returned: 0 in 0.631s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-131c6a76-8aff-407c-a441-cedefadeaff0" released by "delete_volume" :: held 1.319s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['88e4b4a6-48cd-46c8-b138-999e40bc83a6'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:04 devstack cinder-volume[82038]: WARNING cinder.quota [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-447014869 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-447014869, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:36:04 devstack cinder-volume[82038]: WARNING cinder.quota [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-447014869 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-447014869, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['207b3395-29c8-480e-bb7e-9fe45d75a31c', 'a9f8a0b9-e9ca-4a4c-9460-209ef09b84ba', '4a52ba65-5c30-4524-92d3-bc27fe6ad19b', 'f41bef9f-0335-4f47-a4c9-b185cba39b4a'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:04 devstack sudo[85435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:36:04 devstack sudo[85435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:04 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a 1G" returned: 0 in 0.673s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:04 devstack sudo[85441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a Apr 10 10:36:04 devstack sudo[85441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:04 devstack sudo[85435]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.506s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:04 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:04 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-3e0068f4-9776-4a45-b83e-a7331de1257a tempest-GroupSnapshotsTest-1331356635 None] Delete group completed successfully. Apr 10 10:36:05 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] group_snapshot 4046cbab-6b49-4139-8bdb-e053faa21080: deleting Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] group_snapshot 4046cbab-6b49-4139-8bdb-e053faa21080: deleting {{(pid=82038) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-b2ac07e3-721f-4fb0-a666-2173b9f26784" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-b2ac07e3-721f-4fb0-a666-2173b9f26784" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-3d1a941e-3037-432f-ac48-8750564cbd01" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-3d1a941e-3037-432f-ac48-8750564cbd01" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Deleting offline snapshot 3d1a941e-3037-432f-ac48-8750564cbd01 of volume b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] snapshot_file for this snap is: volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2159476e-e516-468f-8cf8-b58f259b29d5]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:05 devstack sudo[85441]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a" returned: 0 in 0.531s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:05 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a is being set with open permissions: ugo+rw Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:05 devstack sudo[85446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 Apr 10 10:36:05 devstack sudo[85446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:05 devstack sudo[85448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a Apr 10 10:36:05 devstack sudo[85448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:05 devstack sudo[85448]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:05 devstack sudo[85446]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a" returned: 0 in 0.531s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01" returned: 0 in 0.632s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b2ac07e3-721f-4fb0-a666-2173b9f26784(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa29090-93ff-4e17-95c3-759b0f9b3763]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:05 devstack sudo[85455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.info Apr 10 10:36:05 devstack sudo[85455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:05 devstack sudo[85456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 Apr 10 10:36:05 devstack sudo[85456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:06 devstack sudo[85455]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.info" returned: 0 in 0.518s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:06 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.info is being set with open permissions: ugo+rw Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:06 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.info Apr 10 10:36:06 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:06 devstack sudo[85456]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784" returned: 0 in 0.661s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:06 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 Apr 10 10:36:06 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:06 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.info" returned: 0 in 0.525s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Acquiring lock "cinder-quobyte-236ea7c7-6a79-4ff6-b223-1d69cf20ae80" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Lock "cinder-quobyte-236ea7c7-6a79-4ff6-b223-1d69cf20ae80" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] snapshot: 3fe78258-8bef-40f1-a807-f548819a167a, volume: 236ea7c7-6a79-4ff6-b223-1d69cf20ae80, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7e12fe-bf3d-4420-91e2-ce2283ad8b77]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:07 devstack sudo[85471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a Apr 10 10:36:07 devstack sudo[85471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:07 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01" returned: 0 in 0.650s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:07 devstack sudo[85473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01 Apr 10 10:36:07 devstack sudo[85473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:07 devstack sudo[85471]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a" returned: 0 in 0.631s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[25171997-88a1-44e0-ba71-a979ba05fcf3]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:07 devstack sudo[85479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 Apr 10 10:36:07 devstack sudo[85479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:07 devstack sudo[85473]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784.3d1a941e-3037-432f-ac48-8750564cbd01" returned: 0 in 0.573s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-3d1a941e-3037-432f-ac48-8750564cbd01" released by "_delete_snapshot" :: held 2.612s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-b2ac07e3-721f-4fb0-a666-2173b9f26784" released by "delete_snapshot" :: held 2.631s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:07 devstack cinder-volume[82038]: WARNING cinder.quota [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-447014869 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-447014869, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:36:07 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['8953c09a-c786-4247-9a5c-b03daab5fd0b', '63676188-ad4f-49c6-9048-750d0ea89bbd', '7858106d-80e2-4d33-82b8-0f5c98ad190c', '104b01d4-3b33-4300-90eb-4379ca598061'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:07 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0f306bc1-52b8-4a23-aed0-72ec30e68ec7 tempest-GroupSnapshotsTest-1331356635 None] group_snapshot 4046cbab-6b49-4139-8bdb-e053faa21080: deleted successfully Apr 10 10:36:08 devstack sudo[85479]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7" returned: 0 in 0.591s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:08 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:36:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:08 devstack sudo[85485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 Apr 10 10:36:08 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-b2ac07e3-721f-4fb0-a666-2173b9f26784" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-b2ac07e3-721f-4fb0-a666-2173b9f26784" acquired by "delete_volume" :: waited 0.022s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:08 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e95aee-b4ef-442c-ba36-4bd7774393c5]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:09 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 Apr 10 10:36:09 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:11 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784" returned: 0 in 2.573s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:11 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784 Apr 10 10:36:11 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:12 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80" returned: 0 in 4.086s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[325237d6-e75d-413c-b493-fcfb092c0af4]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:12 devstack sudo[85556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 Apr 10 10:36:12 devstack sudo[85556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:12 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b2ac07e3-721f-4fb0-a666-2173b9f26784" returned: 0 in 1.160s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-b2ac07e3-721f-4fb0-a666-2173b9f26784" released by "delete_volume" :: held 3.801s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['def7effc-d901-4799-899d-02c444e7e8af'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:12 devstack cinder-volume[82038]: WARNING cinder.db.sqlalchemy.api [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-447014869'] Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['ecd5df00-ccff-46c2-94d7-e47ef77ba9b7', '49d4aa24-31c1-43a1-b96c-cfef8e589d82', '3144979f-5798-4661-b98d-e12b427ba4f2', 'ca9bca92-79e4-4e5d-b5e3-1a2db9edc535'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:12 devstack sudo[85561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:36:12 devstack sudo[85561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:13 devstack sudo[85556]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7" returned: 0 in 0.798s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7, size 1024.00 MB, duration 4.09 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:13 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Converted 1024.00 MB image at 250.49 MB/s Apr 10 10:36:13 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 is being set with open permissions: ugo+rw Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:13 devstack sudo[85564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 Apr 10 10:36:13 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:13 devstack sudo[85561]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.546s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:13 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0466b5fa-2fe5-4772-aa1f-43bc95882397 tempest-GroupSnapshotsTest-1331356635 None] Delete group completed successfully. Apr 10 10:36:13 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80" returned: 0 in 0.590s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Lock "cinder-quobyte-236ea7c7-6a79-4ff6-b223-1d69cf20ae80" released by "_copy_volume_from_snapshot" :: held 6.800s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Acquiring lock "cinder-quobyte-3fe78258-8bef-40f1-a807-f548819a167a" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Lock "cinder-quobyte-3fe78258-8bef-40f1-a807-f548819a167a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Deleting offline snapshot 3fe78258-8bef-40f1-a807-f548819a167a of volume 1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] snapshot_file for this snap is: volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5e70e19-557c-4a0c-a244-5a2da74f7871]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:13 devstack sudo[85568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a Apr 10 10:36:13 devstack sudo[85568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:14 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-493dbefc-1d20-4f33-9395-3a7fe4d9428a tempest-GroupSnapshotsTest-1331356635 None] Group tempest-GroupSnapshotsTest-Group-1804112968: creating Apr 10 10:36:14 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-493dbefc-1d20-4f33-9395-3a7fe4d9428a tempest-GroupSnapshotsTest-1331356635 None] Group tempest-GroupSnapshotsTest-Group-1804112968: created successfully Apr 10 10:36:14 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-493dbefc-1d20-4f33-9395-3a7fe4d9428a tempest-GroupSnapshotsTest-1331356635 None] Create group completed successfully. Apr 10 10:36:14 devstack sudo[85568]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a" returned: 0 in 0.755s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:14 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e346ab-eeec-4adc-bd39-a9a669965091]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:14 devstack sudo[85595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 Apr 10 10:36:14 devstack sudo[85595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:15 devstack sudo[85595]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7" returned: 0 in 0.688s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:15 devstack sudo[85621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a Apr 10 10:36:15 devstack sudo[85621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Flow 'volume_create_manager' (e3428c91-b74d-4f98-84ff-3127c65bde5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7e4216-d48f-4242-8751-b33a5f144d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f7e4216-d48f-4242-8751-b33a5f144d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-38646634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a469eed1-5b22-4e14-838b-c2371f615ba0,host='devstack@QuobyteHD#QuobyteHD',id=2b956183-3110-4841-9239-3ea0ba5bf160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7638ee663643909212284852fc7be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:16Z,use_quota=True,user_id='aa73d1f0c3e2491295df2570ca6d9fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69c24be3-faf2-4fc7-acc9-2b0b09c82ade),volume_type_id=69c24be3-faf2-4fc7-acc9-2b0b09c82ade)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f7397a-dfc4-499c-938e-5117556962ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f7397a-dfc4-499c-938e-5117556962ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9e303c-aa27-4c54-8a3d-5df364727f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be9e303c-aa27-4c54-8a3d-5df364727f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b956183-3110-4841-9239-3ea0ba5bf160', 'volume_name': 'volume-2b956183-3110-4841-9239-3ea0ba5bf160', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5efe9d-8514-42b4-ad63-24a472de6cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de5efe9d-8514-42b4-ad63-24a472de6cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a353869-6fc6-4942-9157-9e9bcb1c4a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:15 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Volume 2b956183-3110-4841-9239-3ea0ba5bf160: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b956183-3110-4841-9239-3ea0ba5bf160', 'volume_size': 1} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:15 devstack sudo[85621]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a" returned: 0 in 0.730s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:16 devstack sudo[85629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a Apr 10 10:36:16 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:16 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7.3fe78258-8bef-40f1-a807-f548819a167a" returned: 0 in 0.507s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Lock "cinder-quobyte-3fe78258-8bef-40f1-a807-f548819a167a" released by "_delete_snapshot" :: held 2.757s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.262s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 12.622s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb243f45-21d4-4792-98ba-a707ea5b3a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80', 'volume_size': 2, 'source_volid': '1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7', 'source_volstatus': 'available'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fb8814-22bf-47ea-ad32-113a9533a7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Creating offline snapshot 651dd742-c2e0-4662-b848-b30f4bfdb0e8 of volume f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:16 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Volume volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 (236ea7c7-6a79-4ff6-b223-1d69cf20ae80): created successfully Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58fb8814-22bf-47ea-ad32-113a9533a7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Flow 'volume_create_manager' (58850fcf-7046-4325-aac2-2846d88a637c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87e7aa8-9202-45ba-8d68-77fb080e5f56]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:16 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d6c586a4-7091-4049-a4b8-57b96fc2f036 tempest-VolumesCloneTest-216933986 None] Created volume successfully. Apr 10 10:36:16 devstack sudo[85632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 Apr 10 10:36:16 devstack sudo[85632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:17 devstack sudo[85632]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0" returned: 0 in 0.637s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:17 devstack sudo[85637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 1G Apr 10 10:36:17 devstack sudo[85637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Acquiring lock "cinder-236ea7c7-6a79-4ff6-b223-1d69cf20ae80-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Lock "cinder-236ea7c7-6a79-4ff6-b223-1d69cf20ae80-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Acquiring lock "cinder-quobyte-236ea7c7-6a79-4ff6-b223-1d69cf20ae80" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:18 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Lock "cinder-quobyte-236ea7c7-6a79-4ff6-b223-1d69cf20ae80" acquired by "delete_volume" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:18 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fe3e95-b7ab-407b-822b-e67728a238f2]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:18 devstack sudo[85637]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 1G" returned: 0 in 0.760s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:18 devstack sudo[85644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 Apr 10 10:36:18 devstack sudo[85644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:18 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 Apr 10 10:36:18 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:18 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80" returned: 0 in 0.634s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:18 devstack sudo[85644]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8" returned: 0 in 0.645s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:18 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 is being set with open permissions: ugo+rw Apr 10 10:36:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:18 devstack sudo[85653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80 Apr 10 10:36:18 devstack sudo[85653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:18 devstack sudo[85655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 Apr 10 10:36:18 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:19 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8" returned: 0 in 0.545s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:19 devstack sudo[85653]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-236ea7c7-6a79-4ff6-b223-1d69cf20ae80" returned: 0 in 0.579s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Lock "cinder-quobyte-236ea7c7-6a79-4ff6-b223-1d69cf20ae80" released by "delete_volume" :: held 1.253s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:19 devstack sudo[85659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.info Apr 10 10:36:19 devstack sudo[85659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Created reservations ['b265e1ee-09d0-4fe9-a5d1-65e6c4a0798e', '8f11e496-3c50-474c-8441-94f9cd46fadf', '6d5d8514-243d-4831-8db0-e462dbfc301d', 'f6239087-031c-4eb6-bb13-e649b72bcebf'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:19 devstack sudo[85661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:36:19 devstack sudo[85661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:19 devstack sudo[85659]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.info" returned: 0 in 0.530s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:19 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.info is being set with open permissions: ugo+rw Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:19 devstack sudo[85665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.info Apr 10 10:36:19 devstack sudo[85665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:19 devstack sudo[85661]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.552s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:19 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Deleted volume successfully. Apr 10 10:36:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9a0dc508-f45b-4be3-9cbf-e152517c1f3c tempest-VolumesCloneTest-216933986 None] Lock "cinder-236ea7c7-6a79-4ff6-b223-1d69cf20ae80-delete_volume" released by "delete_volume" :: held 2.034s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Acquiring lock "cinder-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Lock "cinder-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Acquiring lock "cinder-quobyte-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Lock "cinder-quobyte-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9483c3b-5057-4b8f-b8e8-fe377ed1ab1a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:20 devstack sudo[85668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 Apr 10 10:36:20 devstack sudo[85668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:20 devstack sudo[85665]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.info" returned: 0 in 0.602s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.876s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.471s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a469eed1-5b22-4e14-838b-c2371f615ba0,created_at=2026-04-10T08:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-38646634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a469eed1-5b22-4e14-838b-c2371f615ba0,host='devstack@QuobyteHD#QuobyteHD',id=2b956183-3110-4841-9239-3ea0ba5bf160,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7638ee663643909212284852fc7be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:16Z,use_quota=True,user_id='aa73d1f0c3e2491295df2570ca6d9fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69c24be3-faf2-4fc7-acc9-2b0b09c82ade),volume_type_id=69c24be3-faf2-4fc7-acc9-2b0b09c82ade)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Creating volume 2b956183-3110-4841-9239-3ea0ba5bf160 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:20 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:36:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:20 devstack sudo[85670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 1073741824 Apr 10 10:36:20 devstack sudo[85670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:20 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-581527db-d145-4aae-81a9-39d518aead26 tempest-VolumesDeleteCascade-378882620 None] Create snapshot completed successfully Apr 10 10:36:21 devstack sudo[85668]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7" returned: 0 in 0.700s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:21 devstack sudo[85678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7 Apr 10 10:36:21 devstack sudo[85678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:21 devstack sudo[85670]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 1073741824" returned: 0 in 0.664s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:21 devstack sudo[85680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 Apr 10 10:36:21 devstack sudo[85680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Flow 'volume_create_manager' (c382a63c-e7e6-4fb3-8377-490714c5ef4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3004ee58-7983-4c32-bb6f-8aadee225b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3004ee58-7983-4c32-bb6f-8aadee225b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-672572068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5018e116f38d45e2ba70a4a03bc01deb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=651dd742-c2e0-4662-b848-b30f4bfdb0e8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:21Z,use_quota=True,user_id='8443fd74a29a42e58aad8b59e195388b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf907c91-68db-4d3a-8287-e05e6114623f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf907c91-68db-4d3a-8287-e05e6114623f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ea8c21-5001-435e-9190-966ab71d5f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ea8c21-5001-435e-9190-966ab71d5f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf', 'volume_name': 'volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf', 'volume_size': 1, 'snapshot_id': '651dd742-c2e0-4662-b848-b30f4bfdb0e8'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3be6436-4dc7-4bad-baa5-0c8aff4874a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3be6436-4dc7-4bad-baa5-0c8aff4874a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1d6386-7b91-4f75-985c-ebcd27e0ad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Volume f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf', 'volume_size': 1, 'snapshot_id': '651dd742-c2e0-4662-b848-b30f4bfdb0e8'} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:21 devstack sudo[85678]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7" returned: 0 in 0.520s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Lock "cinder-quobyte-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7" released by "delete_volume" :: held 1.261s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Created reservations ['747b2d30-4c26-4e46-809a-d72485ac2a60', 'bf4fea36-1d51-4b9b-a9d5-4bf005d74d6e', '076648ca-75a7-4322-9253-2557521eb7e5', 'd1107ffa-ffc1-4ac6-a652-70d75e4b2ebb'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:21 devstack sudo[85684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:36:21 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:21 devstack sudo[85680]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160" returned: 0 in 0.637s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.357s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.406s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-651dd742-c2e0-4662-b848-b30f4bfdb0e8-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" by "_create_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a353869-6fc6-4942-9157-9e9bcb1c4a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b956183-3110-4841-9239-3ea0ba5bf160', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269b0f7f-15c0-47bb-a8f1-d4c8e688c8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-651dd742-c2e0-4662-b848-b30f4bfdb0e8-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Creating volume f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf from snapshot 651dd742-c2e0-4662-b848-b30f4bfdb0e8 {{(pid=82038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:21 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Volume volume-2b956183-3110-4841-9239-3ea0ba5bf160 (2b956183-3110-4841-9239-3ea0ba5bf160): created successfully Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269b0f7f-15c0-47bb-a8f1-d4c8e688c8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Flow 'volume_create_manager' (e3428c91-b74d-4f98-84ff-3127c65bde5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:21 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b857c382-b9a4-4d15-9acf-91787814d382 tempest-GroupSnapshotsTest-1331356635 None] Created volume successfully. Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] snapshot: 651dd742-c2e0-4662-b848-b30f4bfdb0e8, volume: f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a1fe7d-9dd7-4e0e-87c0-b03a2f828c00]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:22 devstack sudo[85687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 Apr 10 10:36:22 devstack sudo[85687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:22 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.662s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:22 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:22 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Deleted volume successfully. Apr 10 10:36:22 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4efab38b-16f4-4037-b149-a89c89d036ff tempest-VolumesCloneTest-216933986 None] Lock "cinder-1d013b8e-c9f8-43a3-a2d4-8593bdfbf3e7-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:22 devstack sudo[85687]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8" returned: 0 in 0.832s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:36:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:36:22 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c204c51a-e8ad-41f5-96f8-a11d9a98bf7e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:22 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 Apr 10 10:36:22 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Flow 'volume_create_manager' (43ec94f7-b658-4b0c-af2f-cab7c90053d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc770af3-9907-42cd-bf4e-9160cb46f62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc770af3-9907-42cd-bf4e-9160cb46f62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1644526283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a469eed1-5b22-4e14-838b-c2371f615ba0,host='devstack@QuobyteHD#QuobyteHD',id=9020575f-8486-45c7-8cf5-77932a854da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7638ee663643909212284852fc7be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:23Z,use_quota=True,user_id='aa73d1f0c3e2491295df2570ca6d9fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69c24be3-faf2-4fc7-acc9-2b0b09c82ade),volume_type_id=69c24be3-faf2-4fc7-acc9-2b0b09c82ade)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194876a8-b2dc-4055-8384-12288c07c4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (194876a8-b2dc-4055-8384-12288c07c4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de2427b-337c-4a38-a5c9-4485590f458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9de2427b-337c-4a38-a5c9-4485590f458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9020575f-8486-45c7-8cf5-77932a854da3', 'volume_name': 'volume-9020575f-8486-45c7-8cf5-77932a854da3', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f57bab8-28be-4815-b79b-72d96411e303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f57bab8-28be-4815-b79b-72d96411e303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cebdc4-b2ce-493c-8394-5011521c48ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:23 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Volume 9020575f-8486-45c7-8cf5-77932a854da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9020575f-8486-45c7-8cf5-77932a854da3', 'volume_size': 1} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:23 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0" returned: 0 in 0.931s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:36:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:23 devstack sudo[85699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf Apr 10 10:36:23 devstack sudo[85699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:26 devstack sudo[85699]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" returned: 0 in 3.026s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:26 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[634b4e9a-564c-4e75-9757-7c32f2adb11e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:26 devstack sudo[85726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 Apr 10 10:36:26 devstack sudo[85726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Flow 'volume_create_manager' (8b6f44de-5adc-467b-acc0-d35c933a9b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e059090-85bd-4544-bbf5-398b17fb4ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e059090-85bd-4544-bbf5-398b17fb4ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1374751267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7addb310-c0ed-4bf7-b983-7a4c956d4401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38490ba009f046158c1ae7a206fae6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:27Z,use_quota=True,user_id='9dd434bc38544d1299de8f545dc027ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936657d4-93c5-4228-8081-97f0a0ca947a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (936657d4-93c5-4228-8081-97f0a0ca947a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f90c79-1bb5-442b-974c-d6d2dfcdfa79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36f90c79-1bb5-442b-974c-d6d2dfcdfa79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7addb310-c0ed-4bf7-b983-7a4c956d4401', 'volume_name': 'volume-7addb310-c0ed-4bf7-b983-7a4c956d4401', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2822b13-d3f2-41dd-8854-0cc51ae3c6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2822b13-d3f2-41dd-8854-0cc51ae3c6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d64545-ac56-4a81-9551-ab2fa99324b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:27 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Volume 7addb310-c0ed-4bf7-b983-7a4c956d4401: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7addb310-c0ed-4bf7-b983-7a4c956d4401', 'volume_size': 1} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:27 devstack sudo[85726]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0" returned: 0 in 0.827s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0, size 1024.00 MB, duration 3.03 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:36:27 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Converted 1024.00 MB image at 338.22 MB/s Apr 10 10:36:27 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf is being set with open permissions: ugo+rw Apr 10 10:36:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:27 devstack sudo[85731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf Apr 10 10:36:27 devstack sudo[85731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:28 devstack sudo[85731]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" returned: 0 in 0.523s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" released by "_copy_volume_from_snapshot" :: held 6.258s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-651dd742-c2e0-4662-b848-b30f4bfdb0e8-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" released by "_create_volume_from_snapshot" :: held 6.312s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.351s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.920s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a469eed1-5b22-4e14-838b-c2371f615ba0,created_at=2026-04-10T08:36:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1644526283',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a469eed1-5b22-4e14-838b-c2371f615ba0,host='devstack@QuobyteHD#QuobyteHD',id=9020575f-8486-45c7-8cf5-77932a854da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7638ee663643909212284852fc7be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:23Z,use_quota=True,user_id='aa73d1f0c3e2491295df2570ca6d9fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69c24be3-faf2-4fc7-acc9-2b0b09c82ade),volume_type_id=69c24be3-faf2-4fc7-acc9-2b0b09c82ade)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Creating volume 9020575f-8486-45c7-8cf5-77932a854da3 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:28 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c1d6386-7b91-4f75-985c-ebcd27e0ad11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf', 'volume_size': 1, 'snapshot_id': '651dd742-c2e0-4662-b848-b30f4bfdb0e8'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dc083c-90b2-4eb1-aeae-8c2035f76281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:28 devstack sudo[85737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 1073741824 Apr 10 10:36:28 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:28 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Volume volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf (f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf): created successfully Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6dc083c-90b2-4eb1-aeae-8c2035f76281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Flow 'volume_create_manager' (c382a63c-e7e6-4fb3-8377-490714c5ef4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:28 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0136de8b-4b5d-4526-ad2d-28cc79790a14 tempest-VolumesDeleteCascade-378882620 None] Created volume successfully. Apr 10 10:36:28 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 1073741824" returned: 0 in 0.540s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:28 devstack sudo[85742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 Apr 10 10:36:28 devstack sudo[85742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-f7c95de3-5836-445b-8ca0-561a8fda9cc0-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-f7c95de3-5836-445b-8ca0-561a8fda9cc0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Performing cascade delete. {{(pid=82038) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-651dd742-c2e0-4662-b848-b30f4bfdb0e8-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-651dd742-c2e0-4662-b848-b30f4bfdb0e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-f7c95de3-5836-445b-8ca0-561a8fda9cc0" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-f7c95de3-5836-445b-8ca0-561a8fda9cc0" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-651dd742-c2e0-4662-b848-b30f4bfdb0e8" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-651dd742-c2e0-4662-b848-b30f4bfdb0e8" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Deleting offline snapshot 651dd742-c2e0-4662-b848-b30f4bfdb0e8 of volume f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] snapshot_file for this snap is: volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[591dea35-062e-43fa-99ea-1dec00969dfb]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:29 devstack sudo[85744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 Apr 10 10:36:29 devstack sudo[85744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:29 devstack sudo[85742]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3" returned: 0 in 0.506s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.018s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1374751267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7addb310-c0ed-4bf7-b983-7a4c956d4401,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38490ba009f046158c1ae7a206fae6f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:27Z,use_quota=True,user_id='9dd434bc38544d1299de8f545dc027ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Creating volume 7addb310-c0ed-4bf7-b983-7a4c956d4401 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:29 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09cebdc4-b2ce-493c-8394-5011521c48ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9020575f-8486-45c7-8cf5-77932a854da3', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:29 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401 1073741824 Apr 10 10:36:29 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab590b8-0784-4a77-a2b0-67a1e5745cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:29 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Volume volume-9020575f-8486-45c7-8cf5-77932a854da3 (9020575f-8486-45c7-8cf5-77932a854da3): created successfully Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab590b8-0784-4a77-a2b0-67a1e5745cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Flow 'volume_create_manager' (43ec94f7-b658-4b0c-af2f-cab7c90053d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:29 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-fd1db682-9808-4951-9c96-881350c30d93 tempest-GroupSnapshotsTest-1331356635 None] Created volume successfully. Apr 10 10:36:29 devstack sudo[85744]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8" returned: 0 in 0.689s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a61719-4291-4021-aee1-fc2cf4e4f2e7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:30 devstack sudo[85778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 Apr 10 10:36:30 devstack sudo[85778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:30 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b41dde7f-8239-4650-b0a7-a32a99a57f6e tempest-GroupSnapshotsTest-1331356635 None] Update group completed successfully. Apr 10 10:36:30 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401 1073741824" returned: 0 in 1.010s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:30 devstack sudo[85782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401 Apr 10 10:36:30 devstack sudo[85782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:30 devstack sudo[85778]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0" returned: 0 in 0.848s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:30 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 Apr 10 10:36:30 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:30 devstack sudo[85782]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401" returned: 0 in 0.586s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d64545-ac56-4a81-9551-ab2fa99324b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7addb310-c0ed-4bf7-b983-7a4c956d4401', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73fd620c-1fb2-40af-bfd1-66e26407ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:31 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Volume volume-7addb310-c0ed-4bf7-b983-7a4c956d4401 (7addb310-c0ed-4bf7-b983-7a4c956d4401): created successfully Apr 10 10:36:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73fd620c-1fb2-40af-bfd1-66e26407ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Flow 'volume_create_manager' (8b6f44de-5adc-467b-acc0-d35c933a9b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:31 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c2e602dc-2b0b-438b-b46f-57b2f7070b6c tempest-VolumesNegativeTest-874345262 None] Created volume successfully. Apr 10 10:36:31 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8" returned: 0 in 0.609s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:31 devstack sudo[85794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8 Apr 10 10:36:31 devstack sudo[85794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:31 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-059b2d61-c1a3-47c8-bf56-cadbccdac2ae tempest-GroupSnapshotsTest-1331356635 None] Update group completed successfully. Apr 10 10:36:31 devstack sudo[85794]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0.651dd742-c2e0-4662-b848-b30f4bfdb0e8" returned: 0 in 0.552s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-651dd742-c2e0-4662-b848-b30f4bfdb0e8" released by "_delete_snapshot" :: held 2.786s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-f7c95de3-5836-445b-8ca0-561a8fda9cc0" released by "delete_snapshot" :: held 2.807s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:32 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Created reservations ['33c91664-b4c2-4afa-9789-ff484de4228e', 'b50e8921-2df7-425b-890a-550ef811124a', 'dd67d18e-34be-48df-9b9b-cea059c833a9', '9acb2961-257e-448b-9bbd-b13fd1d3d646'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:32 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Delete snapshot completed successfully. Apr 10 10:36:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-651dd742-c2e0-4662-b848-b30f4bfdb0e8-delete_snapshot" released by "delete_snapshot" :: held 2.980s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Snapshots deleted, issuing volume delete {{(pid=82038) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 10:36:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-f7c95de3-5836-445b-8ca0-561a8fda9cc0" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-f7c95de3-5836-445b-8ca0-561a8fda9cc0" acquired by "delete_volume" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:32 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ee3eb8-3db9-4272-8201-9d058f8af7a8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:32 devstack sudo[85798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 Apr 10 10:36:32 devstack sudo[85798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:32 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0a013998-9bab-4baf-a574-0b6622e8cd47 tempest-GroupSnapshotsTest-1331356635 None] Update group completed successfully. Apr 10 10:36:32 devstack sudo[85798]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0" returned: 0 in 0.749s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:32 devstack sudo[85803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0 Apr 10 10:36:32 devstack sudo[85803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:33 devstack sudo[85803]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7c95de3-5836-445b-8ca0-561a8fda9cc0" returned: 0 in 0.522s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-f7c95de3-5836-445b-8ca0-561a8fda9cc0" released by "delete_volume" :: held 1.331s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:33 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Created reservations ['94d09177-d360-4887-965c-857cd9b3790f', '0298c489-d99e-4586-ba86-b382486266c3', '36fa204e-9b40-418c-b190-b359265fd100', '4c581fb2-c7bf-404d-ac75-61fa95e4b2e6'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:33 devstack sudo[85806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:36:33 devstack sudo[85806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:33 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e1de0221-dacf-4232-ae23-0daad3e4df51 tempest-GroupSnapshotsTest-1331356635 None] Update group completed successfully. Apr 10 10:36:34 devstack sudo[85806]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.571s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:34 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:34 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Deleted volume successfully. Apr 10 10:36:34 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-64209334-c883-4b8a-8a39-c456eb360ee4 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-f7c95de3-5836-445b-8ca0-561a8fda9cc0-delete_volume" released by "delete_volume" :: held 5.099s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:34 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:34 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:34 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:UPDATE=150,cinder:SELECT=139,cinder:INSERT=35,cinder:DELETE=12 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:36:34 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "cinder-quobyte-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:34 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" acquired by "delete_volume" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:34 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf83f0-bfdc-4635-83cf-332208e8d187]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:34 devstack sudo[85809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf Apr 10 10:36:34 devstack sudo[85809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:35 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] GroupSnapshot a4e81ec5-79c2-48a3-8102-820e0ce02f73: creating. Apr 10 10:36:35 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=138,cinder:INSERT=33,cinder:UPDATE=137,cinder:DELETE=7 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:36:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Group snapshot a4e81ec5-79c2-48a3-8102-820e0ce02f73: creating. {{(pid=82038) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:36:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Creating offline snapshot 18d598f5-e66b-4ed6-8f5b-bba36a46793e of volume 9020575f-8486-45c7-8cf5-77932a854da3 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:35 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[64236b5d-f037-4464-8aac-5f52791125ce]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:35 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 Apr 10 10:36:35 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:35 devstack sudo[85809]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" returned: 0 in 0.900s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:35 devstack sudo[85816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf Apr 10 10:36:35 devstack sudo[85816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:36 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3" returned: 0 in 0.648s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:36 devstack sudo[85821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e 1G Apr 10 10:36:36 devstack sudo[85821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:36 devstack sudo[85816]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" returned: 0 in 0.531s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-quobyte-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf" released by "delete_volume" :: held 1.487s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Created reservations ['80883e30-8d2f-4214-b402-62ef54105499', 'e92f6839-9a74-4855-9c5b-c2097a0b2e1b', '0a538f60-f402-4c86-9b1c-257637edb25c', '10c995b8-350e-4812-a636-0fa1a7854165'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:36 devstack sudo[85828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:36:36 devstack sudo[85828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:36 devstack sudo[85821]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e 1G" returned: 0 in 0.612s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9020575f-8486-45c7-8cf5-77932a854da3 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:36 devstack sudo[85836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9020575f-8486-45c7-8cf5-77932a854da3 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e Apr 10 10:36:36 devstack sudo[85836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:37 devstack sudo[85828]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.930s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:37 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:37 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Deleted volume successfully. Apr 10 10:36:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-08e96f64-67a4-4e87-9d5f-7b3a45717a02 tempest-VolumesDeleteCascade-378882620 None] Lock "cinder-f7122d7b-b1cc-4d85-8a49-dbd6734cc9cf-delete_volume" released by "delete_volume" :: held 2.723s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:37 devstack sudo[85836]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9020575f-8486-45c7-8cf5-77932a854da3 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e" returned: 0 in 1.071s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:37 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:36:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:37 devstack sudo[85863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e Apr 10 10:36:37 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:38 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e" returned: 0 in 1.168s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:39 devstack sudo[85870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.info Apr 10 10:36:39 devstack sudo[85870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:36:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:39 devstack sudo[85874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:36:39 devstack sudo[85874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:40 devstack sudo[85874]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.063s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:40 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:40 devstack sudo[85870]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.info" returned: 0 in 1.323s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:40 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:36:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:40 devstack sudo[85888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.info Apr 10 10:36:40 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:41 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.info" returned: 0 in 0.814s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.758s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Creating offline snapshot e2d0a447-8a53-49f3-8835-ee73ae29edb5 of volume 2b956183-3110-4841-9239-3ea0ba5bf160 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:36:41 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a123637-ac1f-432b-9db6-d2d4e6316871]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:41 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 Apr 10 10:36:41 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:41 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160" returned: 0 in 0.695s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:41 devstack sudo[85897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 1G Apr 10 10:36:41 devstack sudo[85897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Flow 'volume_create_manager' (4e19da1d-c143-4b66-8e82-0b1dc0b256e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7561289c-931c-43e6-9d9c-ade826f89910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7561289c-931c-43e6-9d9c-ade826f89910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-754322942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786296e7-a7a6-4388-b473-344df4c8f017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da8dd35650c4af69b538f94d4535148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:42Z,use_quota=True,user_id='1a4979b5c6b54041a93f9eb20f3fbeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77789025-6fa3-4f91-816d-ee9364b4771d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77789025-6fa3-4f91-816d-ee9364b4771d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5135ba2f-ff93-4e52-854e-c8bed0486e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5135ba2f-ff93-4e52-854e-c8bed0486e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786296e7-a7a6-4388-b473-344df4c8f017', 'volume_name': 'volume-786296e7-a7a6-4388-b473-344df4c8f017', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f764f14-930d-49d0-87bf-445a179c6cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f764f14-930d-49d0-87bf-445a179c6cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a10bcda-c602-4a80-9028-3f2446d14499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:42 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Volume 786296e7-a7a6-4388-b473-344df4c8f017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786296e7-a7a6-4388-b473-344df4c8f017', 'volume_size': 1} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:42 devstack sudo[85897]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 1G" returned: 0 in 0.834s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b956183-3110-4841-9239-3ea0ba5bf160 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:42 devstack sudo[85902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b956183-3110-4841-9239-3ea0ba5bf160 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 Apr 10 10:36:42 devstack sudo[85902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:43 devstack sudo[85902]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2b956183-3110-4841-9239-3ea0ba5bf160 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5" returned: 0 in 0.664s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:43 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:36:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:43 devstack sudo[85907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 Apr 10 10:36:43 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:43 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5" returned: 0 in 0.516s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:43 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.info Apr 10 10:36:43 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.info" returned: 0 in 0.542s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:44 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:44 devstack sudo[85916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.info Apr 10 10:36:44 devstack sudo[85916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:44 devstack sudo[85916]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.info" returned: 0 in 0.527s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.863s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.531s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-754322942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786296e7-a7a6-4388-b473-344df4c8f017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da8dd35650c4af69b538f94d4535148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:42Z,use_quota=True,user_id='1a4979b5c6b54041a93f9eb20f3fbeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Creating volume 786296e7-a7a6-4388-b473-344df4c8f017 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:45 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:36:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:45 devstack sudo[85919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017 1073741824 Apr 10 10:36:45 devstack sudo[85919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:45 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-882f3294-9f86-4443-89cb-228aaef1d1c1 tempest-GroupSnapshotsTest-1331356635 None] group_snapshot a4e81ec5-79c2-48a3-8102-820e0ce02f73: created successfully Apr 10 10:36:46 devstack sudo[85919]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017 1073741824" returned: 0 in 1.148s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:46 devstack sudo[85949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017 Apr 10 10:36:46 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:46 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] group_snapshot a4e81ec5-79c2-48a3-8102-820e0ce02f73: deleting Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] group_snapshot a4e81ec5-79c2-48a3-8102-820e0ce02f73: deleting {{(pid=82038) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-9020575f-8486-45c7-8cf5-77932a854da3" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-9020575f-8486-45c7-8cf5-77932a854da3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-18d598f5-e66b-4ed6-8f5b-bba36a46793e" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-18d598f5-e66b-4ed6-8f5b-bba36a46793e" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Deleting offline snapshot 18d598f5-e66b-4ed6-8f5b-bba36a46793e of volume 9020575f-8486-45c7-8cf5-77932a854da3 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] snapshot_file for this snap is: volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b93f7af-f90c-41a8-a5fc-6962f85264a7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:46 devstack sudo[85952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e Apr 10 10:36:46 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:47 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017" returned: 0 in 1.179s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] <== create_volume: return (2387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.391s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a10bcda-c602-4a80-9028-3f2446d14499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786296e7-a7a6-4388-b473-344df4c8f017', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea037511-5342-4d1e-b842-41b00dd3a476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:47 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Volume volume-786296e7-a7a6-4388-b473-344df4c8f017 (786296e7-a7a6-4388-b473-344df4c8f017): created successfully Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea037511-5342-4d1e-b842-41b00dd3a476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Flow 'volume_create_manager' (4e19da1d-c143-4b66-8e82-0b1dc0b256e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-11693a73-bd47-472f-811f-10110c6c1b80 tempest-VolumesTransfersTest-470200884 None] Created volume successfully. Apr 10 10:36:47 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e" returned: 0 in 0.895s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9020575f-8486-45c7-8cf5-77932a854da3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0080ad9-1606-4d2e-b2f3-a8952018114a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:47 devstack sudo[85964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 Apr 10 10:36:47 devstack sudo[85964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:48 devstack sudo[85964]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3" returned: 0 in 1.299s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:49 devstack sudo[85976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e Apr 10 10:36:49 devstack sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:49 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-da8606ef-4740-43f1-86fd-196f01ad7f11 tempest-VolumesTransfersTest-713587392 None] Transfer volume completed successfully. Apr 10 10:36:49 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Flow 'volume_create_manager' (4df1d46e-c184-45d8-a72a-40651e511bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8f8c9f-e69a-43f5-992b-46ec27b21a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a8f8c9f-e69a-43f5-992b-46ec27b21a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bb323b-5a72-47f3-a0b2-d1e250c0c722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b40e2b2a7ae401082d077a1bb578657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:50Z,use_quota=True,user_id='513ab4982f2d4cc79e318f1a49324a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b360fe-6734-4f50-92ee-4484a7b1f8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58b360fe-6734-4f50-92ee-4484a7b1f8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d869f6a7-289a-4ba2-bf62-1b06e6e9185c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:49 devstack cinder-volume[82038]: DEBUG cinder.image.glance [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Creating Keystone auth plugin from conf {{(pid=82038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:36:50 devstack sudo[85976]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e" returned: 0 in 1.413s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:50 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e Apr 10 10:36:50 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d869f6a7-289a-4ba2-bf62-1b06e6e9185c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89bb323b-5a72-47f3-a0b2-d1e250c0c722', 'volume_name': 'volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db46325e-d36b-4d4f-a0f1-92fc9b00c32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db46325e-d36b-4d4f-a0f1-92fc9b00c32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce8764d-0c4f-460f-9ffe-1ea1b7014428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:50 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Volume 89bb323b-5a72-47f3-a0b2-d1e250c0c722: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:36:50 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Trying to clone 89bb323b-5a72-47f3-a0b2-d1e250c0c722 from image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc at location (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]). {{(pid=82038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:36:51 devstack cinder-volume[82038]: INFO cinder.image.image_utils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7f2301-69bd-4b3f-bc70-71187958b6cc]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Acquiring lock "cinder-786296e7-a7a6-4388-b473-344df4c8f017-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Lock "cinder-786296e7-a7a6-4388-b473-344df4c8f017-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Acquiring lock "cinder-quobyte-786296e7-a7a6-4388-b473-344df4c8f017" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Lock "cinder-quobyte-786296e7-a7a6-4388-b473-344df4c8f017" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:51 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD Apr 10 10:36:51 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb36a13c-f725-4df5-91db-16b9c9b87e7a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:51 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3.18d598f5-e66b-4ed6-8f5b-bba36a46793e" returned: 0 in 1.340s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-18d598f5-e66b-4ed6-8f5b-bba36a46793e" released by "_delete_snapshot" :: held 5.127s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-9020575f-8486-45c7-8cf5-77932a854da3" released by "delete_snapshot" :: held 5.207s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:51 devstack sudo[86022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017 Apr 10 10:36:51 devstack sudo[86022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-2b956183-3110-4841-9239-3ea0ba5bf160" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-2b956183-3110-4841-9239-3ea0ba5bf160" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-e2d0a447-8a53-49f3-8835-ee73ae29edb5" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-e2d0a447-8a53-49f3-8835-ee73ae29edb5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Deleting offline snapshot e2d0a447-8a53-49f3-8835-ee73ae29edb5 of volume 2b956183-3110-4841-9239-3ea0ba5bf160 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] snapshot_file for this snap is: volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea1a43b-b92a-42dd-a56f-e054a6b6132a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:52 devstack sudo[86025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 Apr 10 10:36:52 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:53 devstack sudo[86022]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017" returned: 0 in 1.525s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:53 devstack sudo[86036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017 Apr 10 10:36:53 devstack sudo[86036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:53 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD" returned: 0 in 2.015s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:53 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Temporary image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc is fetched for user 513ab4982f2d4cc79e318f1a49324a52. {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:36:53 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5" returned: 0 in 1.329s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2b956183-3110-4841-9239-3ea0ba5bf160(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:36:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87cdd3c-0f84-4218-9d5f-92d9002db211]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50a06d3-f119-4920-8a24-cb85357f8f17]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:53 devstack sudo[86039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD Apr 10 10:36:53 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:53 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 Apr 10 10:36:53 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:54 devstack sudo[86036]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-786296e7-a7a6-4388-b473-344df4c8f017" returned: 0 in 1.066s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Lock "cinder-quobyte-786296e7-a7a6-4388-b473-344df4c8f017" released by "delete_volume" :: held 2.630s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Created reservations ['99767925-2303-46ff-ba49-27ecb928b6ac', '1eab358c-c027-40ae-948d-77d155c597cf', '879c24d7-9875-4dff-abeb-4e565cb1705f', '442edac4-4886-4970-b3c4-07ec2427c141'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:54 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD" returned: 0 in 1.034s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:49Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89bb323b-5a72-47f3-a0b2-d1e250c0c722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b40e2b2a7ae401082d077a1bb578657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:50Z,use_quota=True,user_id='513ab4982f2d4cc79e318f1a49324a52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Creating volume 89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:54 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:54 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 1073741824 Apr 10 10:36:54 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:54 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160" returned: 0 in 1.269s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:54 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 Apr 10 10:36:54 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:54 devstack sudo[86056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:36:54 devstack sudo[86056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:55 devstack sudo[86056]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.811s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:36:55 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Deleted volume successfully. Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-70a3275c-5e53-48c4-841b-b5bedbb2876b tempest-VolumesTransfersTest-703623591 None] Lock "cinder-786296e7-a7a6-4388-b473-344df4c8f017-delete_volume" released by "delete_volume" :: held 4.037s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Flow 'volume_create_manager' (26888b6d-eddf-4fea-b464-9da2e2bba6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bc56e6-f2a7-443f-8f60-b2c96252b443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74bc56e6-f2a7-443f-8f60-b2c96252b443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-513825610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bbd5c6-3d09-4d11-9259-9559844c3f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da8dd35650c4af69b538f94d4535148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:55Z,use_quota=True,user_id='1a4979b5c6b54041a93f9eb20f3fbeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189abecd-09bb-448a-acc4-a0e0efc4538e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189abecd-09bb-448a-acc4-a0e0efc4538e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c278e82-14cb-4016-ba2e-fc481b6694f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c278e82-14cb-4016-ba2e-fc481b6694f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1bbd5c6-3d09-4d11-9259-9559844c3f7a', 'volume_name': 'volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bd5aee-f4b6-4d72-9a74-5865a7f2a350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40bd5aee-f4b6-4d72-9a74-5865a7f2a350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2fee7f-0dbe-4198-832d-bcc0a5bf458a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:55 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Volume a1bbd5c6-3d09-4d11-9259-9559844c3f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a', 'volume_size': 1} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:55 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5" returned: 0 in 1.092s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:55 devstack sudo[86071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5 Apr 10 10:36:55 devstack sudo[86071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:55 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 1073741824" returned: 0 in 1.380s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:55 devstack sudo[86073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 Apr 10 10:36:55 devstack sudo[86073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:56 devstack sudo[86071]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160.e2d0a447-8a53-49f3-8835-ee73ae29edb5" returned: 0 in 0.643s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-e2d0a447-8a53-49f3-8835-ee73ae29edb5" released by "_delete_snapshot" :: held 4.432s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-2b956183-3110-4841-9239-3ea0ba5bf160" released by "delete_snapshot" :: held 4.460s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:36:56 devstack cinder-volume[82038]: WARNING cinder.quota [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1181025759 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1181025759, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:36:56 devstack cinder-volume[82038]: WARNING cinder.quota [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1181025759 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1181025759, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['bf97d275-87f1-4f60-9179-6b1b4de7cfa5', '456a0ed7-4b26-4f7f-b5d6-16a50046c9d2', 'a63a10fa-ff87-46b4-97cf-b6b134a60c81', '63a925bc-1c75-4312-a358-afadf0c43c70'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:56 devstack sudo[86073]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722" returned: 0 in 0.684s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] <== create_volume: return (2122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.126s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.015s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:36:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-513825610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1bbd5c6-3d09-4d11-9259-9559844c3f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da8dd35650c4af69b538f94d4535148',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:36:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:36:55Z,use_quota=True,user_id='1a4979b5c6b54041a93f9eb20f3fbeea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Creating volume a1bbd5c6-3d09-4d11-9259-9559844c3f7a {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:36:56 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['1d77dec0-d7b1-4840-bcb4-360fa471923d', 'b8e3ab30-bc22-4d35-aff0-9ace95c74973', '0d58e7e4-d912-47df-9f5b-5e655e5be25f', '9a6c51ef-d231-483d-92e5-aac512432256'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:36:56 devstack sudo[86077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a 1073741824 Apr 10 10:36:56 devstack sudo[86077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Attempting download of de7026ff-34c2-4bec-b6ea-0aa44cfce4dc ((None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}])) to volume 89bb323b-5a72-47f3-a0b2-d1e250c0c722. {{(pid=82038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de2411b-be38-4a73-9a84-35b4a45f4cc8]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_v0gana6o {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:56 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-3437ddb8-363e-4af6-8d27-b50a2e5f677e tempest-GroupSnapshotsTest-1331356635 None] group_snapshot a4e81ec5-79c2-48a3-8102-820e0ce02f73: deleted successfully Apr 10 10:36:56 devstack sudo[86079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_v0gana6o Apr 10 10:36:56 devstack sudo[86079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:57 devstack sudo[86079]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_v0gana6o" returned: 0 in 0.651s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_v0gana6o {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:57 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_v0gana6o Apr 10 10:36:57 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:57 devstack sudo[86077]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a 1073741824" returned: 0 in 1.065s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:57 devstack sudo[86102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a Apr 10 10:36:57 devstack sudo[86102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-2b956183-3110-4841-9239-3ea0ba5bf160" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-2b956183-3110-4841-9239-3ea0ba5bf160" acquired by "delete_volume" :: waited 0.040s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab2a669-3233-42f9-ad8d-1aa30fcee044]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:58 devstack sudo[86104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 Apr 10 10:36:58 devstack sudo[86104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:58 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_v0gana6o" returned: 1 in 1.280s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_v0gana6o' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e83b108-ed3d-4ec0-a671-f4bb71f4e9cd]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:58 devstack sudo[86109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD Apr 10 10:36:58 devstack sudo[86109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:36:58 devstack sudo[86102]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a" returned: 0 in 1.160s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] <== create_volume: return (2284ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.288s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df2fee7f-0dbe-4198-832d-bcc0a5bf458a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fd85fd-22e3-4390-8064-747275f73d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:36:58 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Volume volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a (a1bbd5c6-3d09-4d11-9259-9559844c3f7a): created successfully Apr 10 10:36:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60fd85fd-22e3-4390-8064-747275f73d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:36:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Flow 'volume_create_manager' (26888b6d-eddf-4fea-b464-9da2e2bba6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:36:59 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c9449e4c-5e19-44a6-9ed9-3a81a9aa8e0e tempest-VolumesTransfersTest-470200884 None] Created volume successfully. Apr 10 10:36:59 devstack sudo[86104]: pam_unix(sudo:session): session closed for user root Apr 10 10:36:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160" returned: 0 in 1.147s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:36:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:36:59 devstack sudo[86148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160 Apr 10 10:36:59 devstack sudo[86148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:00 devstack sudo[86148]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2b956183-3110-4841-9239-3ea0ba5bf160" returned: 0 in 0.714s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-2b956183-3110-4841-9239-3ea0ba5bf160" released by "delete_volume" :: held 2.027s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-9020575f-8486-45c7-8cf5-77932a854da3" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-9020575f-8486-45c7-8cf5-77932a854da3" acquired by "delete_volume" :: waited 0.033s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e3bd84-1bcc-4069-b9c2-786865154755]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:00 devstack sudo[86109]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD" returned: 0 in 1.534s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] de7026ff-34c2-4bec-b6ea-0aa44cfce4dc was qcow2, converting to raw {{(pid=82038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:00 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 Apr 10 10:37:00 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Acquiring lock "cinder-a1bbd5c6-3d09-4d11-9259-9559844c3f7a-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Lock "cinder-a1bbd5c6-3d09-4d11-9259-9559844c3f7a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:00 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Acquiring lock "cinder-quobyte-a1bbd5c6-3d09-4d11-9259-9559844c3f7a" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:00 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Lock "cinder-quobyte-a1bbd5c6-3d09-4d11-9259-9559844c3f7a" acquired by "delete_volume" :: waited 0.028s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[78761b4c-6cee-4e37-bde4-4d26e82a1baa]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:00 devstack sudo[86160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a Apr 10 10:37:00 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:01 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a" returned: 0 in 0.921s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:01 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3" returned: 0 in 1.277s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:01 devstack sudo[86171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a Apr 10 10:37:01 devstack sudo[86171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:01 devstack sudo[86174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3 Apr 10 10:37:01 devstack sudo[86174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:02 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722" returned: 0 in 1.770s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_7e16dr6edevstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:37:02 devstack cinder-volume[82038]: INFO cinder.image.image_utils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Converted 112.00 MB image at 63.16 MB/s Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:02 devstack sudo[86181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 1G Apr 10 10:37:02 devstack sudo[86181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:02 devstack sudo[86171]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a1bbd5c6-3d09-4d11-9259-9559844c3f7a" returned: 0 in 0.712s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Lock "cinder-quobyte-a1bbd5c6-3d09-4d11-9259-9559844c3f7a" released by "delete_volume" :: held 1.670s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Created reservations ['6c34e70e-f940-4dc5-af2c-4a9080f4feab', 'e1fd7a41-ff3e-4a80-bc06-4d25fd3502d1', '60dbe7b6-dc74-4163-aeae-faadb2432904', '792da178-89b4-4390-9c61-5b59be0afdbe'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:02 devstack sudo[86174]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9020575f-8486-45c7-8cf5-77932a854da3" returned: 0 in 0.821s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-9020575f-8486-45c7-8cf5-77932a854da3" released by "delete_volume" :: held 2.177s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['41335520-f6ed-4fb9-bd61-f2f4243a28f5'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:02 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:02 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:02 devstack cinder-volume[82038]: WARNING cinder.quota [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1181025759 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1181025759, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['919e0f2f-5ce4-4e24-b02f-69b6647d4889', '32ab72ce-8dfc-4c1e-b078-0916f2f11122', '15470227-75ab-484b-be8a-7e4f9fc69eb1', '9da67757-1f19-4435-ba68-413dc45fcea2'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['30e0be53-6511-4912-b426-79c9af0baf5d', '4a7521f8-7851-4e08-be7f-26e491ca02a7', 'c4229afa-13e6-4e24-99cc-32bcd02573bd', '0c178548-771b-4b4c-844a-2cf0a1027b47'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:02 devstack sudo[86186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:02 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:03 devstack sudo[86181]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 1G" returned: 0 in 1.221s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:03 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e67b2a-72c3-4e8b-8b22-a3b41d407039]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:03 devstack sudo[86191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 Apr 10 10:37:03 devstack sudo[86191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:03 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-31b3e3c0-b6e9-487d-992c-56961a0be59e tempest-GroupSnapshotsTest-1331356635 None] Group tempest-GroupSnapshotsTest-Group-1486736581: creating Apr 10 10:37:03 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-31b3e3c0-b6e9-487d-992c-56961a0be59e tempest-GroupSnapshotsTest-1331356635 None] Group tempest-GroupSnapshotsTest-Group-1486736581: created successfully Apr 10 10:37:03 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-31b3e3c0-b6e9-487d-992c-56961a0be59e tempest-GroupSnapshotsTest-1331356635 None] Create group completed successfully. Apr 10 10:37:03 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.472s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:03 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:03 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Deleted volume successfully. Apr 10 10:37:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-15e5248d-e95d-408d-ba5a-315066e12c33 tempest-VolumesTransfersTest-703623591 None] Lock "cinder-a1bbd5c6-3d09-4d11-9259-9559844c3f7a-delete_volume" released by "delete_volume" :: held 3.477s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:04 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.269s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:04 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:04 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0bb9f759-5d71-402e-93a8-a18ef52fde9e tempest-GroupSnapshotsTest-1331356635 None] Delete group completed successfully. Apr 10 10:37:04 devstack sudo[86191]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722" returned: 0 in 1.322s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:04 devstack sudo[86199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 Apr 10 10:37:04 devstack sudo[86199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Flow 'volume_create_manager' (78f65e2b-f6bd-4771-a5ed-cff3646c0629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36325dc-6a54-49f3-a7e1-9c7cbc901ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:05 devstack sudo[86199]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36325dc-6a54-49f3-a7e1-9c7cbc901ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-444988897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2976ce72-2a83-4f08-95ac-dea10299d6c9,host='devstack@QuobyteHD#QuobyteHD',id=27f61866-6cf8-48f4-b5b6-b2df60bdc645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7638ee663643909212284852fc7be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:06Z,use_quota=True,user_id='aa73d1f0c3e2491295df2570ca6d9fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3e647f3-ed17-45bd-b9fb-a0142c889b61),volume_type_id=b3e647f3-ed17-45bd-b9fb-a0142c889b61)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abe9be3-00eb-4b99-8f3e-f70962fe8ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abe9be3-00eb-4b99-8f3e-f70962fe8ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05ef579-cbef-4689-8ae4-96ff100e2d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05ef579-cbef-4689-8ae4-96ff100e2d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f61866-6cf8-48f4-b5b6-b2df60bdc645', 'volume_name': 'volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffe83d6-1613-4f5b-b666-362976804c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fffe83d6-1613-4f5b-b666-362976804c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98a6038-924c-409c-a1eb-0f66db1b405b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:05 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Volume 27f61866-6cf8-48f4-b5b6-b2df60bdc645: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645', 'volume_size': 1} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=2976ce72-2a83-4f08-95ac-dea10299d6c9,created_at=2026-04-10T08:37:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-444988897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=2976ce72-2a83-4f08-95ac-dea10299d6c9,host='devstack@QuobyteHD#QuobyteHD',id=27f61866-6cf8-48f4-b5b6-b2df60bdc645,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e7638ee663643909212284852fc7be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:06Z,use_quota=True,user_id='aa73d1f0c3e2491295df2570ca6d9fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3e647f3-ed17-45bd-b9fb-a0142c889b61),volume_type_id=b3e647f3-ed17-45bd-b9fb-a0142c889b61)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Creating volume 27f61866-6cf8-48f4-b5b6-b2df60bdc645 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:05 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722" returned: 1 in 1.147s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Downloaded image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc ((None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}])) to volume 89bb323b-5a72-47f3-a0b2-d1e250c0c722 successfully. {{(pid=82038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Temporary image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc for user 513ab4982f2d4cc79e318f1a49324a52 is deleted. {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Marking volume 89bb323b-5a72-47f3-a0b2-d1e250c0c722 as bootable. {{(pid=82038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Copying metadata from image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc to 89bb323b-5a72-47f3-a0b2-d1e250c0c722. {{(pid=82038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Creating volume glance metadata for volume 89bb323b-5a72-47f3-a0b2-d1e250c0c722 backed by image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:37:05 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 1073741824 Apr 10 10:37:05 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dce8764d-0c4f-460f-9ffe-1ea1b7014428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5064c780-8671-45bf-9118-cf1a672bdd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:05 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Volume volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 (89bb323b-5a72-47f3-a0b2-d1e250c0c722): created successfully Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5064c780-8671-45bf-9118-cf1a672bdd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Flow 'volume_create_manager' (4df1d46e-c184-45d8-a72a-40651e511bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:06 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-cb2e376b-fef3-4250-bc57-88a49ed1b4c9 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Created volume successfully. Apr 10 10:37:06 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 1073741824" returned: 0 in 0.922s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:06 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 Apr 10 10:37:06 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Acquiring lock "cinder-7addb310-c0ed-4bf7-b983-7a4c956d4401-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Lock "cinder-7addb310-c0ed-4bf7-b983-7a4c956d4401-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Acquiring lock "cinder-quobyte-7addb310-c0ed-4bf7-b983-7a4c956d4401" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Lock "cinder-quobyte-7addb310-c0ed-4bf7-b983-7a4c956d4401" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:06 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5d6cb0-3d83-481b-9708-edc2f6b8b9dd]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:07 devstack sudo[86213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401 Apr 10 10:37:07 devstack sudo[86213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:07 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645" returned: 0 in 0.803s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98a6038-924c-409c-a1eb-0f66db1b405b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebb35c0-1ba5-4971-9ff4-afd1162e7229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:07 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Volume volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 (27f61866-6cf8-48f4-b5b6-b2df60bdc645): created successfully Apr 10 10:37:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eebb35c0-1ba5-4971-9ff4-afd1162e7229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Flow 'volume_create_manager' (78f65e2b-f6bd-4771-a5ed-cff3646c0629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:07 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-2c7ae938-6121-4c82-841b-e0fa600c2846 tempest-GroupSnapshotsTest-1331356635 None] Created volume successfully. Apr 10 10:37:07 devstack sudo[86213]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401" returned: 0 in 0.751s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:07 devstack sudo[86219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401 Apr 10 10:37:07 devstack sudo[86219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:07 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] GroupSnapshot 076c6f3a-e9b0-47de-80f1-d8001547cf44: creating. Apr 10 10:37:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Group snapshot 076c6f3a-e9b0-47de-80f1-d8001547cf44: creating. {{(pid=82038) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Creating offline snapshot fbf4bde4-6c61-4677-8bc4-49133b82a480 of volume 27f61866-6cf8-48f4-b5b6-b2df60bdc645 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2826d3cb-b0d4-474c-b57f-42edaf747317]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:08 devstack sudo[86221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 Apr 10 10:37:08 devstack sudo[86221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:08 devstack sudo[86219]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7addb310-c0ed-4bf7-b983-7a4c956d4401" returned: 0 in 0.684s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Lock "cinder-quobyte-7addb310-c0ed-4bf7-b983-7a4c956d4401" released by "delete_volume" :: held 1.471s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Created reservations ['17735ed0-1419-4751-acc1-4292e798663b', '9fafa000-f412-471b-80a0-e67655bb127e', 'fa6f35d1-9387-489c-a813-43de2eea2354', '19b9723c-25e7-4855-9dd1-7b7be0ce78ed'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-8c0f5198-f408-4b14-9f1c-d6110e37e632 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:08 devstack sudo[86236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:08 devstack sudo[86236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:08 devstack sudo[86221]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645" returned: 0 in 0.775s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:08 devstack sudo[86238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 1G Apr 10 10:37:08 devstack sudo[86238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:09 devstack sudo[86236]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.531s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:09 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Deleted volume successfully. Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cf0316-48e8-493c-bf74-1e1518750f1b tempest-VolumesNegativeTest-874345262 None] Lock "cinder-7addb310-c0ed-4bf7-b983-7a4c956d4401-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Flow 'volume_create_manager' (9566b630-0ee1-4617-a968-b44cc0bf80b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59cfea2d-cd21-4433-9f08-7d1b595c94b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59cfea2d-cd21-4433-9f08-7d1b595c94b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-676964626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279036cf-0008-4a4b-9ddd-c3b0f33212ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b7669d308c740a6b60881f4a592873d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:09Z,use_quota=True,user_id='6dd7fb19a9b7420da4d078f3ed0fafbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1f5665-93b8-404c-8e3c-47fc0302cfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e1f5665-93b8-404c-8e3c-47fc0302cfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14bfed4-c09b-4a87-a35e-49ba72364387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a14bfed4-c09b-4a87-a35e-49ba72364387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279036cf-0008-4a4b-9ddd-c3b0f33212ca', 'volume_name': 'volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca', 'volume_size': 2}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107879e5-1114-4c24-aa94-d4c7706f2d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (107879e5-1114-4c24-aa94-d4c7706f2d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18f7469-5ab4-42c0-8d7a-71407018fcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:09 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Volume 279036cf-0008-4a4b-9ddd-c3b0f33212ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca', 'volume_size': 2} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:09 devstack sudo[86238]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 1G" returned: 0 in 0.625s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:09 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 Apr 10 10:37:09 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:10 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480" returned: 0 in 0.632s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:10 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:37:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:10 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 Apr 10 10:37:10 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:10 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480" returned: 0 in 0.609s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:10 devstack sudo[86252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.info Apr 10 10:37:10 devstack sudo[86252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:11 devstack sudo[86252]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.info" returned: 0 in 0.552s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:11 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:11 devstack sudo[86255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.info Apr 10 10:37:11 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Flow 'volume_create_manager' (5c6999dd-832c-45b9-8b9b-1d38d57a10d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b8d4aa-afd2-4b96-85d7-fc8a48b66f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b8d4aa-afd2-4b96-85d7-fc8a48b66f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-416724476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13c6101-53f7-4f7d-8faa-66d02bbceed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e0acffde7f44ff90798607f464a38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:12Z,use_quota=True,user_id='9796c85b256047e9801fa91ed18c0e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec28b68-9eaf-416d-8c23-008cb48701f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec28b68-9eaf-416d-8c23-008cb48701f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727b414d-7ac6-489e-a9ba-91cc8be78231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727b414d-7ac6-489e-a9ba-91cc8be78231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c13c6101-53f7-4f7d-8faa-66d02bbceed8', 'volume_name': 'volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8', 'volume_size': 2}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b892fc0-d6dd-475b-9a33-4c06e73c1dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b892fc0-d6dd-475b-9a33-4c06e73c1dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ea8036-e41a-430c-af73-d9598efc3c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:11 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Volume c13c6101-53f7-4f7d-8faa-66d02bbceed8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8', 'volume_size': 2} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:11 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.info" returned: 0 in 0.595s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.865s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-8c0f5198-f408-4b14-9f1c-d6110e37e632 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.179s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0311ffc-4b16-4ee7-903a-62f9ed8ad2ee]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-8c0f5198-f408-4b14-9f1c-d6110e37e632 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:11 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f9d76635-d278-4b30-8809-651b01036b72 tempest-GroupSnapshotsTest-1331356635 None] group_snapshot 076c6f3a-e9b0-47de-80f1-d8001547cf44: created successfully Apr 10 10:37:12 devstack sudo[86259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 Apr 10 10:37:12 devstack sudo[86259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:12 devstack sudo[86259]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-8c0f5198-f408-4b14-9f1c-d6110e37e632 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722" returned: 0 in 0.535s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-8c0f5198-f408-4b14-9f1c-d6110e37e632 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:12 devstack sudo[86263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 Apr 10 10:37:12 devstack sudo[86263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:12 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] group_snapshot 076c6f3a-e9b0-47de-80f1-d8001547cf44: deleting Apr 10 10:37:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] group_snapshot 076c6f3a-e9b0-47de-80f1-d8001547cf44: deleting {{(pid=82038) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:37:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-27f61866-6cf8-48f4-b5b6-b2df60bdc645" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-27f61866-6cf8-48f4-b5b6-b2df60bdc645" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-fbf4bde4-6c61-4677-8bc4-49133b82a480" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-fbf4bde4-6c61-4677-8bc4-49133b82a480" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Deleting offline snapshot fbf4bde4-6c61-4677-8bc4-49133b82a480 of volume 27f61866-6cf8-48f4-b5b6-b2df60bdc645 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] snapshot_file for this snap is: volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7334349-2a60-4035-aa58-4eb583d929bd]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:13 devstack sudo[86263]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-8c0f5198-f408-4b14-9f1c-d6110e37e632 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722" returned: 1 in 0.595s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-8c0f5198-f408-4b14-9f1c-d6110e37e632 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-8c0f5198-f408-4b14-9f1c-d6110e37e632 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.171s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.621s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-676964626',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279036cf-0008-4a4b-9ddd-c3b0f33212ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b7669d308c740a6b60881f4a592873d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:09Z,use_quota=True,user_id='6dd7fb19a9b7420da4d078f3ed0fafbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Creating volume 279036cf-0008-4a4b-9ddd-c3b0f33212ca {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:13 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca 2147483648 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:13 devstack sudo[86269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca 2147483648 Apr 10 10:37:13 devstack sudo[86269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-8c0f5198-f408-4b14-9f1c-d6110e37e632 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e', 'name': 'volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a55be2ae-04e1-4e4c-a6e3-ba80f9a78a8e', 'enforce_multipath': True} {{(pid=82038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 10:37:13 devstack sudo[86268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 Apr 10 10:37:13 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:13 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-1ed88623-8223-4397-87a9-8787c7fb5ebd req-8c0f5198-f408-4b14-9f1c-d6110e37e632 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] attachment_update completed successfully. Apr 10 10:37:13 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480" returned: 0 in 0.694s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffce2b50-2d1a-4e32-8960-74e2eb06fda1]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:13 devstack sudo[86269]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca 2147483648" returned: 0 in 0.689s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:13 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca Apr 10 10:37:13 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:13 devstack sudo[86278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 Apr 10 10:37:13 devstack sudo[86278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:14 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca" returned: 0 in 0.761s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.732s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-416724476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c13c6101-53f7-4f7d-8faa-66d02bbceed8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='44e0acffde7f44ff90798607f464a38f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:12Z,use_quota=True,user_id='9796c85b256047e9801fa91ed18c0e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Creating volume c13c6101-53f7-4f7d-8faa-66d02bbceed8 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:14 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 2147483648 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18f7469-5ab4-42c0-8d7a-71407018fcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca', 'volume_size': 2}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af70f790-7f2a-4a20-a17e-5a33be4155b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:14 devstack sudo[86278]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:14 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 2147483648 Apr 10 10:37:14 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645" returned: 0 in 0.889s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:14 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Volume volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca (279036cf-0008-4a4b-9ddd-c3b0f33212ca): created successfully Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af70f790-7f2a-4a20-a17e-5a33be4155b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Flow 'volume_create_manager' (9566b630-0ee1-4617-a968-b44cc0bf80b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:14 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-22515687-8ac0-41bc-be7d-76343ddd6b31 tempest-VolumesCloneNegativeTest-1956917243 None] Created volume successfully. Apr 10 10:37:14 devstack sudo[86288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 Apr 10 10:37:14 devstack sudo[86288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Acquiring lock "cinder-279036cf-0008-4a4b-9ddd-c3b0f33212ca-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Lock "cinder-279036cf-0008-4a4b-9ddd-c3b0f33212ca-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Acquiring lock "cinder-quobyte-279036cf-0008-4a4b-9ddd-c3b0f33212ca" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Lock "cinder-quobyte-279036cf-0008-4a4b-9ddd-c3b0f33212ca" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:15 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e891852-882c-4b05-965e-d6d4774c9872]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:15 devstack sudo[86288]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480" returned: 0 in 0.835s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:15 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480 Apr 10 10:37:15 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:15 devstack sudo[86296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca Apr 10 10:37:15 devstack sudo[86296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:15 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 2147483648" returned: 0 in 1.148s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:15 devstack sudo[86300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 Apr 10 10:37:15 devstack sudo[86300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:16 devstack sudo[86296]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca" returned: 0 in 0.671s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:16 devstack sudo[86306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca Apr 10 10:37:16 devstack sudo[86306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:16 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645.fbf4bde4-6c61-4677-8bc4-49133b82a480" returned: 0 in 0.722s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-fbf4bde4-6c61-4677-8bc4-49133b82a480" released by "_delete_snapshot" :: held 3.223s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-27f61866-6cf8-48f4-b5b6-b2df60bdc645" released by "delete_snapshot" :: held 3.238s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:16 devstack cinder-volume[82038]: WARNING cinder.quota [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1126171174 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1126171174, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:37:16 devstack cinder-volume[82038]: WARNING cinder.quota [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1126171174 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1126171174, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['255b9c69-f903-44f0-b90b-f2c228bfdd2c', '769f0cfb-595d-498f-956c-181208fd4a6b', '9172b19b-95f1-43a4-bd85-4e6855d19574', 'cef0243e-d07b-4c35-a6ae-182723994fa9'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:16 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-5196ad4d-315a-4759-8109-99bc279dfefa tempest-GroupSnapshotsTest-1331356635 None] group_snapshot 076c6f3a-e9b0-47de-80f1-d8001547cf44: deleted successfully Apr 10 10:37:16 devstack sudo[86300]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8" returned: 0 in 0.674s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] <== create_volume: return (1872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5ea8036-e41a-430c-af73-d9598efc3c32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8', 'volume_size': 2}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3d0a52-e567-4e64-bed5-2798dbc71190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:16 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Volume volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 (c13c6101-53f7-4f7d-8faa-66d02bbceed8): created successfully Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c3d0a52-e567-4e64-bed5-2798dbc71190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Flow 'volume_create_manager' (5c6999dd-832c-45b9-8b9b-1d38d57a10d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:16 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-973a9753-6693-4409-88fe-c3c2a50717d7 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Created volume successfully. Apr 10 10:37:16 devstack sudo[86306]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-279036cf-0008-4a4b-9ddd-c3b0f33212ca" returned: 0 in 0.518s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Lock "cinder-quobyte-279036cf-0008-4a4b-9ddd-c3b0f33212ca" released by "delete_volume" :: held 1.226s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Created reservations ['500aab5f-6cbd-466c-8f8f-6738ba8a9df8', '5da9a6be-686a-41cf-b792-43b4b09715e6', '0fcff7fb-9c65-4919-8b53-be9ef9c41874', '9db30db7-2859-49d0-b4ba-b163cbb53e65'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:16 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:16 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Creating offline snapshot 41e98103-7a81-46fe-bcca-6ab7cc0381d9 of volume c13c6101-53f7-4f7d-8faa-66d02bbceed8 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:17 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.604s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d44084b-d7c7-4d10-bfc1-ddfc18df79b3]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:17 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Deleted volume successfully. Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4010106d-6d74-4bda-adb7-eebb66702c02 tempest-VolumesCloneNegativeTest-1956917243 None] Lock "cinder-279036cf-0008-4a4b-9ddd-c3b0f33212ca-delete_volume" released by "delete_volume" :: held 2.049s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:17 devstack sudo[86316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 Apr 10 10:37:17 devstack sudo[86316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "cinder-quobyte-27f61866-6cf8-48f4-b5b6-b2df60bdc645" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-27f61866-6cf8-48f4-b5b6-b2df60bdc645" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6066543e-b658-46dd-89f9-5cf1c5947fb7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:17 devstack sudo[86318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 Apr 10 10:37:17 devstack sudo[86318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:18 devstack sudo[86316]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8" returned: 0 in 0.622s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 2G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:18 devstack sudo[86323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 2G Apr 10 10:37:18 devstack sudo[86323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:18 devstack sudo[86318]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645" returned: 0 in 0.719s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:18 devstack sudo[86343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645 Apr 10 10:37:18 devstack sudo[86343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:18 devstack sudo[86323]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 2G" returned: 0 in 0.914s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:18 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 Apr 10 10:37:18 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:19 devstack sudo[86343]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-27f61866-6cf8-48f4-b5b6-b2df60bdc645" returned: 0 in 0.868s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Lock "cinder-quobyte-27f61866-6cf8-48f4-b5b6-b2df60bdc645" released by "delete_volume" :: held 1.644s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:19 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['71a41786-b276-4c13-8688-41e827c2ea7f'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:19 devstack cinder-volume[82038]: WARNING cinder.quota [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1126171174 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1126171174, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:37:19 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Created reservations ['746bccc3-e649-4574-9c53-4372aeb1994c', 'a0787972-a50f-483d-837f-313a78b8094c', '092d4ae4-3342-4913-bbe0-d45355486172', '568b8252-1a1a-40ba-9e30-41560ef53799'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:19 devstack sudo[86359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:19 devstack sudo[86359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:20 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9" returned: 0 in 1.122s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:20 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 is being set with open permissions: ugo+rw Apr 10 10:37:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:20 devstack sudo[86365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 Apr 10 10:37:20 devstack sudo[86365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:20 devstack sudo[86359]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.154s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:20 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:20 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d5395bb8-8eae-4989-8b75-7eb9ae842350 tempest-GroupSnapshotsTest-1331356635 None] Delete group completed successfully. Apr 10 10:37:21 devstack sudo[86365]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9" returned: 0 in 1.248s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:21 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.info Apr 10 10:37:21 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Flow 'volume_create_manager' (36141c2f-4023-45b5-a053-001eb889cea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86accd70-ef88-424b-b7b5-1efe5aec84ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86accd70-ef88-424b-b7b5-1efe5aec84ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-100882465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cbd494-206d-440e-a429-3057d736dbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0100e0f71a9d4366bd2ba72f1d0c0f4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:22Z,use_quota=True,user_id='873e701fde674a4ea8c01bf7789d24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87add9ca-181e-4133-8bb3-500f8eb9feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87add9ca-181e-4133-8bb3-500f8eb9feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5ef68a-4242-4bcc-b13a-f2b8c12ab83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.image.glance [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Creating Keystone auth plugin from conf {{(pid=82038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:37:22 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.info" returned: 0 in 1.172s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:22 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.info is being set with open permissions: ugo+rw Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:22 devstack sudo[86373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.info Apr 10 10:37:22 devstack sudo[86373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f5ef68a-4242-4bcc-b13a-f2b8c12ab83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '49cbd494-206d-440e-a429-3057d736dbf4', 'volume_name': 'volume-49cbd494-206d-440e-a429-3057d736dbf4', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e44418b-c71c-4ea5-8332-e8db39ec545e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e44418b-c71c-4ea5-8332-e8db39ec545e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a377a43c-2f5c-4c04-a18f-a906d9a7ef31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:22 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Volume 49cbd494-206d-440e-a429-3057d736dbf4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-49cbd494-206d-440e-a429-3057d736dbf4', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:37:22 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Trying to clone 49cbd494-206d-440e-a429-3057d736dbf4 from image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc at location (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]). {{(pid=82038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:37:23 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58cec24-655c-4469-b54c-cd0643f516f7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:23 devstack sudo[86376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD Apr 10 10:37:23 devstack sudo[86376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:23 devstack sudo[86373]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.info" returned: 0 in 0.814s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.010s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:23 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-60f5a426-47af-4dc0-aae7-7bb3bc96d7db tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Create snapshot completed successfully Apr 10 10:37:23 devstack sudo[86376]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD" returned: 0 in 0.758s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Temporary image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc is fetched for user 873e701fde674a4ea8c01bf7789d24b1. {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[99efcf17-1d7d-42f1-a64d-8c223f6aefc0]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Acquiring lock "cinder-41e98103-7a81-46fe-bcca-6ab7cc0381d9-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "cinder-41e98103-7a81-46fe-bcca-6ab7cc0381d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Acquiring lock "cinder-quobyte-c13c6101-53f7-4f7d-8faa-66d02bbceed8" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "cinder-quobyte-c13c6101-53f7-4f7d-8faa-66d02bbceed8" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Acquiring lock "cinder-quobyte-41e98103-7a81-46fe-bcca-6ab7cc0381d9" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "cinder-quobyte-41e98103-7a81-46fe-bcca-6ab7cc0381d9" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Deleting offline snapshot 41e98103-7a81-46fe-bcca-6ab7cc0381d9 of volume c13c6101-53f7-4f7d-8faa-66d02bbceed8 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:23 devstack sudo[86382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD Apr 10 10:37:23 devstack sudo[86382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] snapshot_file for this snap is: volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b255a0c-345b-477e-a222-f5890499a9f1]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:24 devstack sudo[86384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 Apr 10 10:37:24 devstack sudo[86384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:24 devstack sudo[86382]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD" returned: 0 in 0.731s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-100882465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49cbd494-206d-440e-a429-3057d736dbf4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0100e0f71a9d4366bd2ba72f1d0c0f4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:22Z,use_quota=True,user_id='873e701fde674a4ea8c01bf7789d24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Creating volume 49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:24 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:24 devstack sudo[86392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 1073741824 Apr 10 10:37:24 devstack sudo[86392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:24 devstack sudo[86384]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9" returned: 0 in 0.684s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abc11d5-3bd5-4d74-a445-726d2d3ffcfa]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:24 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 Apr 10 10:37:24 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:25 devstack sudo[86392]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 1073741824" returned: 0 in 0.854s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:25 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8" returned: 0 in 0.807s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:25 devstack sudo[86402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 Apr 10 10:37:25 devstack sudo[86402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:25 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 Apr 10 10:37:25 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:25 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b9ea098b-1581-4d54-af24-cff1bd0fa2df tempest-GroupSnapshotsV319Test-1926078213 None] Group tempest-GroupSnapshotsV319Test-Group-1419607559: creating Apr 10 10:37:25 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b9ea098b-1581-4d54-af24-cff1bd0fa2df tempest-GroupSnapshotsV319Test-1926078213 None] Group tempest-GroupSnapshotsV319Test-Group-1419607559: created successfully Apr 10 10:37:25 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b9ea098b-1581-4d54-af24-cff1bd0fa2df tempest-GroupSnapshotsV319Test-1926078213 None] Create group completed successfully. Apr 10 10:37:26 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4" returned: 0 in 0.555s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Attempting download of de7026ff-34c2-4bec-b6ea-0aa44cfce4dc ((None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}])) to volume 49cbd494-206d-440e-a429-3057d736dbf4. {{(pid=82038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d62012-a2f6-4616-9d4a-ea7d019e3136]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_i75k743r {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:26 devstack sudo[86402]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9" returned: 0 in 0.721s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:26 devstack sudo[86416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_i75k743r Apr 10 10:37:26 devstack sudo[86416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:26 devstack sudo[86421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9 Apr 10 10:37:26 devstack sudo[86421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:26 devstack sudo[86421]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8.41e98103-7a81-46fe-bcca-6ab7cc0381d9" returned: 0 in 0.588s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "cinder-quobyte-41e98103-7a81-46fe-bcca-6ab7cc0381d9" released by "_delete_snapshot" :: held 2.898s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "cinder-quobyte-c13c6101-53f7-4f7d-8faa-66d02bbceed8" released by "delete_snapshot" :: held 2.915s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:26 devstack sudo[86416]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_i75k743r" returned: 0 in 0.759s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_i75k743r {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:26 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Created reservations ['4a4e8f33-674d-4733-8635-f14668fa43ee', '194c2d5a-fe4d-4ab1-bfc4-265812a3ed06', '1f25132c-633c-465f-8fed-a217a2896792', '4383e4de-5972-460a-9114-9e6625d52f66'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:27 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Delete snapshot completed successfully. Apr 10 10:37:27 devstack sudo[86442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_i75k743r Apr 10 10:37:27 devstack sudo[86442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f669d2c8-a4b9-4bff-81cf-26f60c9644a9 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "cinder-41e98103-7a81-46fe-bcca-6ab7cc0381d9-delete_snapshot" released by "delete_snapshot" :: held 3.085s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Acquiring lock "cinder-c13c6101-53f7-4f7d-8faa-66d02bbceed8-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "cinder-c13c6101-53f7-4f7d-8faa-66d02bbceed8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Acquiring lock "cinder-quobyte-c13c6101-53f7-4f7d-8faa-66d02bbceed8" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "cinder-quobyte-c13c6101-53f7-4f7d-8faa-66d02bbceed8" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc775b76-6f60-4bfa-9778-512538cf7818]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Flow 'volume_create_manager' (fd7bc910-820b-43c9-b979-3235b53b5c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8bf2c7-aa4c-4dc9-a5ac-d6cc4d085a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa8bf2c7-aa4c-4dc9-a5ac-d6cc4d085a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2021938836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18c8cba7-406d-4bd7-b4a3-282e6738d949,host='devstack@QuobyteHD#QuobyteHD',id=e84dc4fe-9036-47ab-9a17-502358c9ca51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0af585adf044b4b836f03b759a75afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:27Z,use_quota=True,user_id='d809a4ea3b6e4c1f8d5d08f324e61f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f278b14-7c16-4f29-a322-daf0584497bc),volume_type_id=5f278b14-7c16-4f29-a322-daf0584497bc)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef23f228-9d11-4e89-8bb8-b8ad2a5dd4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef23f228-9d11-4e89-8bb8-b8ad2a5dd4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack sudo[86444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c492b1-3ff1-4d89-a14f-1eb8217d3d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack sudo[86444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7c492b1-3ff1-4d89-a14f-1eb8217d3d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e84dc4fe-9036-47ab-9a17-502358c9ca51', 'volume_name': 'volume-e84dc4fe-9036-47ab-9a17-502358c9ca51', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51979696-119d-4026-b422-87c3a3bff8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51979696-119d-4026-b422-87c3a3bff8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee03b7c8-70bf-4886-b92b-cdc3f372e885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:27 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Volume e84dc4fe-9036-47ab-9a17-502358c9ca51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e84dc4fe-9036-47ab-9a17-502358c9ca51', 'volume_size': 1} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=18c8cba7-406d-4bd7-b4a3-282e6738d949,created_at=2026-04-10T08:37:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2021938836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=18c8cba7-406d-4bd7-b4a3-282e6738d949,host='devstack@QuobyteHD#QuobyteHD',id=e84dc4fe-9036-47ab-9a17-502358c9ca51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0af585adf044b4b836f03b759a75afc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:27Z,use_quota=True,user_id='d809a4ea3b6e4c1f8d5d08f324e61f64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f278b14-7c16-4f29-a322-daf0584497bc),volume_type_id=5f278b14-7c16-4f29-a322-daf0584497bc)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Creating volume e84dc4fe-9036-47ab-9a17-502358c9ca51 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:27 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:27 devstack sudo[86446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 1073741824 Apr 10 10:37:27 devstack sudo[86446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:27 devstack sudo[86442]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_i75k743r" returned: 1 in 0.849s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_i75k743r' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cafcc08-5db8-4d42-b9ef-095e1e25bdde]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:27 devstack sudo[86450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD Apr 10 10:37:27 devstack sudo[86450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:27 devstack sudo[86444]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8" returned: 0 in 0.665s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack sudo[86463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8 Apr 10 10:37:28 devstack sudo[86463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack sudo[86446]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 1073741824" returned: 0 in 0.754s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 Apr 10 10:37:28 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack sudo[86450]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD" returned: 0 in 0.661s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] de7026ff-34c2-4bec-b6ea-0aa44cfce4dc was qcow2, converting to raw {{(pid=82038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack sudo[86483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 Apr 10 10:37:28 devstack sudo[86483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack sudo[86463]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c13c6101-53f7-4f7d-8faa-66d02bbceed8" returned: 0 in 0.565s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "cinder-quobyte-c13c6101-53f7-4f7d-8faa-66d02bbceed8" released by "delete_volume" :: held 1.275s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Created reservations ['46a8ce2b-be81-4ba5-b87f-532926e77a55', '2ff9b492-8dfa-4899-9c42-190fd6310d03', '546d31a9-19ca-46b4-8100-f66cce8c8702', 'bc0f2d7d-372c-4828-822c-14efe4c8f020'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:28 devstack sudo[86485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:28 devstack sudo[86485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:28 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51" returned: 0 in 0.572s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee03b7c8-70bf-4886-b92b-cdc3f372e885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e84dc4fe-9036-47ab-9a17-502358c9ca51', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904626e9-5676-4bbe-8009-c7f9471d07f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:28 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Volume volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 (e84dc4fe-9036-47ab-9a17-502358c9ca51): created successfully Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (904626e9-5676-4bbe-8009-c7f9471d07f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Flow 'volume_create_manager' (fd7bc910-820b-43c9-b979-3235b53b5c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:28 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-6ebcb2a2-0294-474c-92a1-c294dc6111e0 tempest-GroupSnapshotsV319Test-1926078213 None] Created volume successfully. Apr 10 10:37:29 devstack sudo[86485]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.521s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:29 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Deleted volume successfully. Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9abf4d4a-b173-4b5f-b9ef-b626e7081e40 tempest-VolumesSnapshotNegativeTestJSON-327936797 None] Lock "cinder-c13c6101-53f7-4f7d-8faa-66d02bbceed8-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:29 devstack sudo[86483]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:29 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] GroupSnapshot b862f51b-42e0-4dd8-b9d4-12f9e2b0d376: creating. Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4" returned: 0 in 1.269s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_k2z1kh59devstack@QuobyteHD, size 112.00 MB, duration 1.27 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:37:29 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Converted 112.00 MB image at 88.01 MB/s Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Group snapshot b862f51b-42e0-4dd8-b9d4-12f9e2b0d376: creating. {{(pid=82038) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 10:37:29 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 1G Apr 10 10:37:29 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Creating offline snapshot bafeedab-c35e-4079-8497-f1c79442087e of volume e84dc4fe-9036-47ab-9a17-502358c9ca51 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fd1d62-e783-4ff9-932e-c395c6c758d8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:29 devstack sudo[86497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 Apr 10 10:37:29 devstack sudo[86497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:30 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 1G" returned: 0 in 0.731s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:30 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2a9dd5-7985-4f1b-89ef-c482c8af92f9]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:30 devstack sudo[86497]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51" returned: 0 in 0.719s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:30 devstack sudo[86506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e 1G Apr 10 10:37:30 devstack sudo[86506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:30 devstack sudo[86505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 Apr 10 10:37:30 devstack sudo[86505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:31 devstack sudo[86505]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4" returned: 0 in 0.686s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:31 devstack sudo[86514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 Apr 10 10:37:31 devstack sudo[86514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:31 devstack sudo[86506]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e 1G" returned: 0 in 0.894s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:31 devstack sudo[86516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e Apr 10 10:37:31 devstack sudo[86516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:31 devstack sudo[86514]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4" returned: 1 in 0.743s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Downloaded image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc ((None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}])) to volume 49cbd494-206d-440e-a429-3057d736dbf4 successfully. {{(pid=82038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Temporary image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc for user 873e701fde674a4ea8c01bf7789d24b1 is deleted. {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Marking volume 49cbd494-206d-440e-a429-3057d736dbf4 as bootable. {{(pid=82038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Copying metadata from image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc to 49cbd494-206d-440e-a429-3057d736dbf4. {{(pid=82038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:37:31 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Creating volume glance metadata for volume 49cbd494-206d-440e-a429-3057d736dbf4 backed by image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a377a43c-2f5c-4c04-a18f-a906d9a7ef31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49cbd494-206d-440e-a429-3057d736dbf4', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0d0674-756d-403c-88b5-82faee0efb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Volume volume-49cbd494-206d-440e-a429-3057d736dbf4 (49cbd494-206d-440e-a429-3057d736dbf4): created successfully Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0d0674-756d-403c-88b5-82faee0efb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Flow 'volume_create_manager' (36141c2f-4023-45b5-a053-001eb889cea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:32 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-679238fc-b72f-48ed-9ca3-b9aec3b7f8d2 tempest-VolumesExtendTest-529048422 None] Created volume successfully. Apr 10 10:37:32 devstack sudo[86516]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e" returned: 0 in 0.657s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:32 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:32 devstack sudo[86525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e Apr 10 10:37:32 devstack sudo[86525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Flow 'volume_create_manager' (ddcc19ea-f10f-4001-a345-e12a02159173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515b685b-4f2e-41a0-8e59-656dd1e5089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515b685b-4f2e-41a0-8e59-656dd1e5089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1044480611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5d7855-d78c-4051-bcb2-2818e2449b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2785c94ce4ca9aee016fe23c5953b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:32Z,use_quota=True,user_id='3d271a8cadae4260b4048ae4cd3a1dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e789f996-e826-49f3-9ae6-ea70f31f6a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e789f996-e826-49f3-9ae6-ea70f31f6a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe06a84-6ebb-4963-b244-5ca9c84085d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe06a84-6ebb-4963-b244-5ca9c84085d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c5d7855-d78c-4051-bcb2-2818e2449b76', 'volume_name': 'volume-1c5d7855-d78c-4051-bcb2-2818e2449b76', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c21b907-a7be-4e42-af85-a43a22a965b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c21b907-a7be-4e42-af85-a43a22a965b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b66f76-79f2-4ee5-bca6-4a55e21b0ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Volume 1c5d7855-d78c-4051-bcb2-2818e2449b76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c5d7855-d78c-4051-bcb2-2818e2449b76', 'volume_size': 1} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Flow 'volume_create_manager' (44d32e19-9471-4998-b25c-82f8dbb075dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b52e3e-ca84-421c-9be4-7b20181f0580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b52e3e-ca84-421c-9be4-7b20181f0580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1632644275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430fcdab-115f-4e8d-92fc-726600092921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2785c94ce4ca9aee016fe23c5953b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:32Z,use_quota=True,user_id='3d271a8cadae4260b4048ae4cd3a1dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74200784-b86e-456a-891c-dbb14910de02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74200784-b86e-456a-891c-dbb14910de02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be8a11c-3ba6-49a5-9603-49f54bbe6e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be8a11c-3ba6-49a5-9603-49f54bbe6e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '430fcdab-115f-4e8d-92fc-726600092921', 'volume_name': 'volume-430fcdab-115f-4e8d-92fc-726600092921', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258691c0-321f-4548-9c06-221f1791b405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (258691c0-321f-4548-9c06-221f1791b405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4121bd68-817e-4049-aa38-28f6b48c9282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:32 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Volume 430fcdab-115f-4e8d-92fc-726600092921: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-430fcdab-115f-4e8d-92fc-726600092921', 'volume_size': 1} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:32 devstack sudo[86525]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e" returned: 0 in 0.644s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:32 devstack sudo[86552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.info Apr 10 10:37:32 devstack sudo[86552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Flow 'volume_create_manager' (5a5bdf2f-cd11-469d-9d23-3b9fcc5925dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4291c9e6-bb5e-43af-b2b6-df6f8bf0d0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4291c9e6-bb5e-43af-b2b6-df6f8bf0d0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-263055945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd02f74-15c2-44ba-81ab-ea575c01c5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2785c94ce4ca9aee016fe23c5953b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:33Z,use_quota=True,user_id='3d271a8cadae4260b4048ae4cd3a1dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1293417-4b10-40e0-899d-d32759bf334d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1293417-4b10-40e0-899d-d32759bf334d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e1f632-52db-4e09-9eb0-6d69bd0a5f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e1f632-52db-4e09-9eb0-6d69bd0a5f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd02f74-15c2-44ba-81ab-ea575c01c5d5', 'volume_name': 'volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262b6d50-be7e-4df7-86f9-d218ca069ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262b6d50-be7e-4df7-86f9-d218ca069ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab1088c-a7d1-4841-835e-c51cfa29c08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Volume dcd02f74-15c2-44ba-81ab-ea575c01c5d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5', 'volume_size': 1} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Flow 'volume_create_manager' (b6ffaf63-072a-48cc-9991-ae0ab0addd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47d50fd-3a34-4470-a59e-fe8b2734cebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c47d50fd-3a34-4470-a59e-fe8b2734cebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1569286005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a49c9e-d864-4ea9-a3de-f2ea7baab3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2785c94ce4ca9aee016fe23c5953b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:33Z,use_quota=True,user_id='3d271a8cadae4260b4048ae4cd3a1dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad0dd9f-083f-46c9-ba38-84b932529f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad0dd9f-083f-46c9-ba38-84b932529f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6299d7b-9ce5-4528-98e0-4e5900d097fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6299d7b-9ce5-4528-98e0-4e5900d097fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a49c9e-d864-4ea9-a3de-f2ea7baab3a1', 'volume_name': 'volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a739f1d-8489-4b5d-bbe6-c153d318509d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a739f1d-8489-4b5d-bbe6-c153d318509d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4496a73-e1a0-4c07-aa72-64623acf233d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:33 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Volume 19a49c9e-d864-4ea9-a3de-f2ea7baab3a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1', 'volume_size': 1} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:33 devstack sudo[86552]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.info" returned: 0 in 1.098s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:33 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:33 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.info Apr 10 10:37:33 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Flow 'volume_create_manager' (129a754c-a527-439e-aa10-47a74fb9c5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02bdc3e0-6813-4d09-a03a-68e497e7b269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02bdc3e0-6813-4d09-a03a-68e497e7b269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403514957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f498ee-2b3e-4b49-adaf-76cd12fb3c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2785c94ce4ca9aee016fe23c5953b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:34Z,use_quota=True,user_id='3d271a8cadae4260b4048ae4cd3a1dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4790ddc-e544-4cd2-b6d7-f2299df2dfd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4790ddc-e544-4cd2-b6d7-f2299df2dfd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1430a4-0d5f-40da-ad62-a1b4c7cefb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c1430a4-0d5f-40da-ad62-a1b4c7cefb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34f498ee-2b3e-4b49-adaf-76cd12fb3c4b', 'volume_name': 'volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9038074-55a2-4d11-89af-5f98e8c0ddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9038074-55a2-4d11-89af-5f98e8c0ddc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca1c96b-eba1-46e5-a000-a3a2a3f0ba77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:34 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Volume 34f498ee-2b3e-4b49-adaf-76cd12fb3c4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b', 'volume_size': 1} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:34 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.info" returned: 0 in 0.592s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.703s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.198s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1044480611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c5d7855-d78c-4051-bcb2-2818e2449b76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2785c94ce4ca9aee016fe23c5953b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:32Z,use_quota=True,user_id='3d271a8cadae4260b4048ae4cd3a1dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Creating volume 1c5d7855-d78c-4051-bcb2-2818e2449b76 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:34 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:34 devstack sudo[86560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76 1073741824 Apr 10 10:37:34 devstack sudo[86560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:34 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4bff27d8-9be0-47cc-8b68-4ddb9ca4a513 tempest-GroupSnapshotsV319Test-1926078213 None] group_snapshot b862f51b-42e0-4dd8-b9d4-12f9e2b0d376: created successfully Apr 10 10:37:35 devstack sudo[86560]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76 1073741824" returned: 0 in 0.751s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=149,cinder:UPDATE=157,cinder:DELETE=6,cinder:INSERT=43 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:35 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76 Apr 10 10:37:35 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:35 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] group_snapshot b862f51b-42e0-4dd8-b9d4-12f9e2b0d376: deleting Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] group_snapshot b862f51b-42e0-4dd8-b9d4-12f9e2b0d376: deleting {{(pid=82038) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=143,cinder:INSERT=51,cinder:UPDATE=131,cinder:DELETE=9 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Acquiring lock "cinder-quobyte-e84dc4fe-9036-47ab-9a17-502358c9ca51" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Lock "cinder-quobyte-e84dc4fe-9036-47ab-9a17-502358c9ca51" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Acquiring lock "cinder-quobyte-bafeedab-c35e-4079-8497-f1c79442087e" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Lock "cinder-quobyte-bafeedab-c35e-4079-8497-f1c79442087e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Deleting offline snapshot bafeedab-c35e-4079-8497-f1c79442087e of volume e84dc4fe-9036-47ab-9a17-502358c9ca51 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] snapshot_file for this snap is: volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4413e8e9-d4e4-44d2-a4ee-bc83e17819ab]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:35 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e Apr 10 10:37:35 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:35 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76" returned: 0 in 0.591s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] <== create_volume: return (1396ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.400s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.562s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5b66f76-79f2-4ee5-bca6-4a55e21b0ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c5d7855-d78c-4051-bcb2-2818e2449b76', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9c6330-bdf2-4405-86db-6d85c36c0bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf7240d-5ff4-4f41-aa63-0b49bf2fcc08]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:35 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Volume volume-1c5d7855-d78c-4051-bcb2-2818e2449b76 (1c5d7855-d78c-4051-bcb2-2818e2449b76): created successfully Apr 10 10:37:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e9c6330-bdf2-4405-86db-6d85c36c0bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Flow 'volume_create_manager' (ddcc19ea-f10f-4001-a345-e12a02159173) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:36 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-5588cb41-f23d-41c8-b104-181cbe9cb6a9 tempest-CreateVolumesFromImageTest-2080362665 None] Created volume successfully. Apr 10 10:37:36 devstack sudo[86570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 Apr 10 10:37:36 devstack sudo[86570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:36 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e" returned: 0 in 0.800s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e84dc4fe-9036-47ab-9a17-502358c9ca51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:36 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2961122-4b21-49f6-8f6b-1ac3680a0a0d]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:36 devstack sudo[86575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 Apr 10 10:37:36 devstack sudo[86575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:36 devstack sudo[86570]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4" returned: 0 in 0.561s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:36 devstack sudo[86579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 Apr 10 10:37:36 devstack sudo[86579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:36 devstack sudo[86575]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51" returned: 0 in 0.564s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:36 devstack sudo[86584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e Apr 10 10:37:36 devstack sudo[86584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:37 devstack sudo[86579]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4" returned: 1 in 0.654s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 2G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 2G" returned: 0 in 0.087s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.369s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.661s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1632644275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=430fcdab-115f-4e8d-92fc-726600092921,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2785c94ce4ca9aee016fe23c5953b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:32Z,use_quota=True,user_id='3d271a8cadae4260b4048ae4cd3a1dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Creating volume 430fcdab-115f-4e8d-92fc-726600092921 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:37 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:37 devstack sudo[86618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921 1073741824 Apr 10 10:37:37 devstack sudo[86618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:37 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4f5d426e-45ab-4a91-9179-de6705af9525 tempest-VolumesExtendTest-529048422 None] Extend volume completed successfully. Apr 10 10:37:37 devstack sudo[86584]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e" returned: 0 in 0.705s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:37 devstack sudo[86623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e Apr 10 10:37:37 devstack sudo[86623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Acquiring lock "cinder-49cbd494-206d-440e-a429-3057d736dbf4-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Lock "cinder-49cbd494-206d-440e-a429-3057d736dbf4-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Acquiring lock "cinder-quobyte-49cbd494-206d-440e-a429-3057d736dbf4" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Lock "cinder-quobyte-49cbd494-206d-440e-a429-3057d736dbf4" acquired by "delete_volume" :: waited 0.020s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:38 devstack sudo[86618]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921 1073741824" returned: 0 in 1.004s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c986c0d6-ac51-4d22-affd-d1916d9fb844]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:38 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 Apr 10 10:37:38 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:38 devstack sudo[86651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921 Apr 10 10:37:38 devstack sudo[86651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:38 devstack sudo[86623]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51.bafeedab-c35e-4079-8497-f1c79442087e" returned: 0 in 0.900s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Lock "cinder-quobyte-bafeedab-c35e-4079-8497-f1c79442087e" released by "_delete_snapshot" :: held 3.070s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Lock "cinder-quobyte-e84dc4fe-9036-47ab-9a17-502358c9ca51" released by "delete_snapshot" :: held 3.097s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:38 devstack cinder-volume[82038]: WARNING cinder.quota [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-942424112 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-942424112, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:37:38 devstack cinder-volume[82038]: WARNING cinder.quota [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-942424112 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-942424112, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:37:38 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] Created reservations ['00bd2395-dd84-4327-827e-dac8e1f571e7', '57fe85fa-807c-449e-8154-7ed38c822f98', '241b96b1-f3cd-48bd-86b9-17ca50f53e96', 'b7c76ccd-65f1-4d22-a8cc-533d6c085741'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:38 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0572551c-c48c-456a-b3c5-56922be1b3cd tempest-GroupSnapshotsV319Test-1926078213 None] group_snapshot b862f51b-42e0-4dd8-b9d4-12f9e2b0d376: deleted successfully Apr 10 10:37:39 devstack sudo[86651]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921" returned: 0 in 0.628s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.812s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-263055945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd02f74-15c2-44ba-81ab-ea575c01c5d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2785c94ce4ca9aee016fe23c5953b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:33Z,use_quota=True,user_id='3d271a8cadae4260b4048ae4cd3a1dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Creating volume dcd02f74-15c2-44ba-81ab-ea575c01c5d5 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:39 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4121bd68-817e-4049-aa38-28f6b48c9282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-430fcdab-115f-4e8d-92fc-726600092921', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b7876a-758b-420f-aafe-8c4ca2c982a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:39 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5 1073741824 Apr 10 10:37:39 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:39 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Volume volume-430fcdab-115f-4e8d-92fc-726600092921 (430fcdab-115f-4e8d-92fc-726600092921): created successfully Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b7876a-758b-420f-aafe-8c4ca2c982a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Flow 'volume_create_manager' (44d32e19-9471-4998-b25c-82f8dbb075dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:39 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-44bb2cb5-e293-4e93-b348-3b77aafed99a tempest-CreateVolumesFromImageTest-2080362665 None] Created volume successfully. Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:39 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4" returned: 0 in 0.851s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:39 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:39 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:39 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 Apr 10 10:37:39 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:39 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5 1073741824" returned: 0 in 0.762s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:39 devstack sudo[86670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5 Apr 10 10:37:39 devstack sudo[86670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4" returned: 1 in 0.866s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack sudo[86672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4 Apr 10 10:37:40 devstack sudo[86672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Acquiring lock "cinder-quobyte-e84dc4fe-9036-47ab-9a17-502358c9ca51" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Lock "cinder-quobyte-e84dc4fe-9036-47ab-9a17-502358c9ca51" acquired by "delete_volume" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c148a594-7adf-46a6-ad72-282a3431d2ec]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:40 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 1.257s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:40 devstack sudo[86675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 Apr 10 10:37:40 devstack sudo[86675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:40 devstack sudo[86672]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49cbd494-206d-440e-a429-3057d736dbf4" returned: 0 in 0.838s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Lock "cinder-quobyte-49cbd494-206d-440e-a429-3057d736dbf4" released by "delete_volume" :: held 2.675s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:40 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Created reservations ['d24a6cc0-02d6-4896-bde8-2dd37172c486', '72ad2698-05f5-41f4-bc73-fb3e6249b0eb', '1aaff0b7-3fc3-4b88-b5b2-490e01528990', '8f68d7b2-9f78-496e-b914-d8da04709b6f'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:41 devstack sudo[86670]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5" returned: 0 in 1.155s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] <== create_volume: return (2007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.472s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1569286005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19a49c9e-d864-4ea9-a3de-f2ea7baab3a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2785c94ce4ca9aee016fe23c5953b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:33Z,use_quota=True,user_id='3d271a8cadae4260b4048ae4cd3a1dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Creating volume 19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:41 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:41 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 1073741824 Apr 10 10:37:41 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab1088c-a7d1-4841-835e-c51cfa29c08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0027d662-88d1-424a-9b8e-a8e13ea38438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:41 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Volume volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5 (dcd02f74-15c2-44ba-81ab-ea575c01c5d5): created successfully Apr 10 10:37:41 devstack sudo[86684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0027d662-88d1-424a-9b8e-a8e13ea38438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:41 devstack sudo[86684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Flow 'volume_create_manager' (5a5bdf2f-cd11-469d-9d23-3b9fcc5925dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:41 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-00ed2db2-acfb-452b-ba32-d5685c87abd9 tempest-CreateVolumesFromImageTest-2080362665 None] Created volume successfully. Apr 10 10:37:41 devstack sudo[86675]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51" returned: 0 in 0.909s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:41 devstack sudo[86686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51 Apr 10 10:37:41 devstack sudo[86686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:41 devstack sudo[86686]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e84dc4fe-9036-47ab-9a17-502358c9ca51" returned: 0 in 0.736s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Lock "cinder-quobyte-e84dc4fe-9036-47ab-9a17-502358c9ca51" released by "delete_volume" :: held 1.713s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:42 devstack sudo[86684]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.935s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:42 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Deleted volume successfully. Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5293f257-a4dd-40d5-9f5f-21faa294bd49 tempest-VolumesExtendTest-529048422 None] Lock "cinder-49cbd494-206d-440e-a429-3057d736dbf4-delete_volume" released by "delete_volume" :: held 4.016s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Created reservations ['bd23e07e-0ba5-4fb7-b715-9e78a0f966c7'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:42 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Flow 'volume_create_manager' (f29c387d-1e2e-4846-8900-b7fa00a51459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8730ff17-8bcc-4cf9-9fab-4053b7e510c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 1073741824" returned: 0 in 1.148s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:42 devstack cinder-volume[82038]: WARNING cinder.quota [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-942424112 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-942424112, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8730ff17-8bcc-4cf9-9fab-4053b7e510c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1987530504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639d2968-875c-406f-a4b4-59a0fc993369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0100e0f71a9d4366bd2ba72f1d0c0f4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:42Z,use_quota=True,user_id='873e701fde674a4ea8c01bf7789d24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a736b8da-9d43-4c64-849e-32a2afa32888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a736b8da-9d43-4c64-849e-32a2afa32888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3352d5b-b678-465a-8e8e-d22904f7ab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3352d5b-b678-465a-8e8e-d22904f7ab6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '639d2968-875c-406f-a4b4-59a0fc993369', 'volume_name': 'volume-639d2968-875c-406f-a4b4-59a0fc993369', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3485a70e-e53d-40ae-ab5f-776fcd44e999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3485a70e-e53d-40ae-ab5f-776fcd44e999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5c9406-c89d-4400-bdb8-8b35bbb1655c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:42 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Volume 639d2968-875c-406f-a4b4-59a0fc993369: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-639d2968-875c-406f-a4b4-59a0fc993369', 'volume_size': 1} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Created reservations ['6b111948-86b7-48d0-a489-778dcb9d7c5d', '5971565c-0b5e-4e8b-9633-0979529d3d20', '10058434-4f71-41ad-832b-269325bb9636', '0f0b73e3-3e2a-46f2-aad4-28dc8702ebd5'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:42 devstack sudo[86719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 Apr 10 10:37:42 devstack sudo[86719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:42 devstack sudo[86722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:42 devstack sudo[86722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:42 devstack sudo[86719]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1" returned: 0 in 0.672s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] <== create_volume: return (1937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.924s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-403514957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34f498ee-2b3e-4b49-adaf-76cd12fb3c4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9a2785c94ce4ca9aee016fe23c5953b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:34Z,use_quota=True,user_id='3d271a8cadae4260b4048ae4cd3a1dde',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Creating volume 34f498ee-2b3e-4b49-adaf-76cd12fb3c4b {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:42 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4496a73-e1a0-4c07-aa72-64623acf233d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b264a1a-6491-4ab8-b418-e8e7b1f55d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:43 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Volume volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 (19a49c9e-d864-4ea9-a3de-f2ea7baab3a1): created successfully Apr 10 10:37:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b264a1a-6491-4ab8-b418-e8e7b1f55d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:43 devstack sudo[86727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b 1073741824 Apr 10 10:37:43 devstack sudo[86727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Flow 'volume_create_manager' (b6ffaf63-072a-48cc-9991-ae0ab0addd93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:43 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-477bd29b-b8fa-4a97-abb9-600eb6e74a09 tempest-CreateVolumesFromImageTest-2080362665 None] Created volume successfully. Apr 10 10:37:43 devstack sudo[86722]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.632s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:43 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:43 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-2df5fe4a-1064-475e-824f-9214d1ac3d9c tempest-GroupSnapshotsV319Test-1926078213 None] Delete group completed successfully. Apr 10 10:37:43 devstack sudo[86727]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b 1073741824" returned: 0 in 0.762s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:43 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b Apr 10 10:37:43 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:44 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b" returned: 0 in 0.583s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] <== create_volume: return (1387ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.125s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1987530504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=639d2968-875c-406f-a4b4-59a0fc993369,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0100e0f71a9d4366bd2ba72f1d0c0f4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:42Z,use_quota=True,user_id='873e701fde674a4ea8c01bf7789d24b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Creating volume 639d2968-875c-406f-a4b4-59a0fc993369 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:44 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca1c96b-eba1-46e5-a000-a3a2a3f0ba77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:44 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 1073741824 Apr 10 10:37:44 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7449a56e-2b8c-40b5-a92c-cd20a3bd28d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:44 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Volume volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b (34f498ee-2b3e-4b49-adaf-76cd12fb3c4b): created successfully Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7449a56e-2b8c-40b5-a92c-cd20a3bd28d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Flow 'volume_create_manager' (129a754c-a527-439e-aa10-47a74fb9c5fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-621ee23f-5d23-4055-9f6a-a99e5a8d00fb tempest-CreateVolumesFromImageTest-2080362665 None] Created volume successfully. Apr 10 10:37:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-21bd7cc4-cb7e-4f40-804e-b57674ecad8a tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Terminate volume connection completed successfully. Apr 10 10:37:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-21bd7cc4-cb7e-4f40-804e-b57674ecad8a tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Deleting attachment a55be2ae-04e1-4e4c-a6e3-ba80f9a78a8e. {{(pid=82038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 10:37:45 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 1073741824" returned: 0 in 0.669s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:45 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 Apr 10 10:37:45 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "cinder-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "cinder-quobyte-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-quobyte-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bc0e2f-d867-4ae9-bd84-fc84196b1afb]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "cinder-89bb323b-5a72-47f3-a0b2-d1e250c0c722-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "cinder-89bb323b-5a72-47f3-a0b2-d1e250c0c722-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:45 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b Apr 10 10:37:45 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "cinder-quobyte-89bb323b-5a72-47f3-a0b2-d1e250c0c722" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "cinder-quobyte-89bb323b-5a72-47f3-a0b2-d1e250c0c722" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9abd058-38ca-427d-a865-e7755192a68d]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:45 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 Apr 10 10:37:45 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:45 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369" returned: 0 in 0.619s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5c9406-c89d-4400-bdb8-8b35bbb1655c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-639d2968-875c-406f-a4b4-59a0fc993369', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e389f379-c481-4fe5-9de5-1fd7bddc26ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:45 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Volume volume-639d2968-875c-406f-a4b4-59a0fc993369 (639d2968-875c-406f-a4b4-59a0fc993369): created successfully Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e389f379-c481-4fe5-9de5-1fd7bddc26ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Flow 'volume_create_manager' (f29c387d-1e2e-4846-8900-b7fa00a51459) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:45 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ecd20322-ecf0-4a63-a124-d9d042452153 tempest-VolumesExtendTest-529048422 None] Created volume successfully. Apr 10 10:37:45 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b" returned: 0 in 0.699s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:45 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b Apr 10 10:37:45 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:46 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722" returned: 0 in 0.730s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:46 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 Apr 10 10:37:46 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:46 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b" returned: 0 in 0.680s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-quobyte-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b" released by "delete_volume" :: held 1.430s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Creating offline snapshot 64465fee-6f6a-48bf-a4c8-f864aee56fd3 of volume 639d2968-875c-406f-a4b4-59a0fc993369 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eb9eb9-302a-451f-823a-443ed5447038]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Created reservations ['9b8fcb6c-7b9e-4f08-849d-fe70d0209cf1', 'e9824926-3d3d-47fb-863e-99dc6b72f22a', '305fcc25-f208-48ca-9560-3f94d029bd3a', '74330783-e8d0-4657-9b26-1a88e3bdfe5c'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:46 devstack sudo[86762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 Apr 10 10:37:46 devstack sudo[86762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:46 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722" returned: 1 in 0.678s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:37:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:46 devstack sudo[86770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:46 devstack sudo[86770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:46 devstack sudo[86772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722 Apr 10 10:37:46 devstack sudo[86772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e248448c-0749-4bb2-9d06-a4a6001ebd7e tempest-GroupsTest-788584442 None] Group tempest-Group1-621508469: creating Apr 10 10:37:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e248448c-0749-4bb2-9d06-a4a6001ebd7e tempest-GroupsTest-788584442 None] Group tempest-Group1-621508469: created successfully Apr 10 10:37:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e248448c-0749-4bb2-9d06-a4a6001ebd7e tempest-GroupsTest-788584442 None] Create group completed successfully. Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "cinder-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "cinder-quobyte-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-quobyte-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb6812c-374c-4484-b1b4-beb7fdb4b6a1]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:47 devstack sudo[86770]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.749s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Deleted volume successfully. Apr 10 10:37:47 devstack sudo[86789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 Apr 10 10:37:47 devstack sudo[86789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54827464-0332-409d-8983-ef6a3d8b51c1 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-34f498ee-2b3e-4b49-adaf-76cd12fb3c4b-delete_volume" released by "delete_volume" :: held 2.448s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:47 devstack sudo[86762]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369" returned: 0 in 0.984s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:47 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 1G Apr 10 10:37:47 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:47 devstack sudo[86772]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-89bb323b-5a72-47f3-a0b2-d1e250c0c722" returned: 0 in 0.860s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "cinder-quobyte-89bb323b-5a72-47f3-a0b2-d1e250c0c722" released by "delete_volume" :: held 2.332s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG cinder.quota [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Created reservations ['58683118-4501-42a6-b734-c4ed52603b89', '9b3d3465-a491-46be-bbc3-bb4d2d091b4f', '8779d394-6edb-4823-82f8-a10003ff2743', 'fec35bce-edf4-41b1-9b80-693aeddaa9bb'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:47 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:47 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:48 devstack sudo[86789]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1" returned: 0 in 0.688s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack sudo[86803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1 Apr 10 10:37:48 devstack sudo[86803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-db5e68ca-c194-43af-a763-034ff2990c20 tempest-GroupsTest-788584442 None] Group tempest-Group2-1723725198: creating Apr 10 10:37:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-db5e68ca-c194-43af-a763-034ff2990c20 tempest-GroupsTest-788584442 None] Group tempest-Group2-1723725198: created successfully Apr 10 10:37:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-db5e68ca-c194-43af-a763-034ff2990c20 tempest-GroupsTest-788584442 None] Create group completed successfully. Apr 10 10:37:48 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 1G" returned: 0 in 0.730s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639d2968-875c-406f-a4b4-59a0fc993369 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack sudo[86806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639d2968-875c-406f-a4b4-59a0fc993369 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 Apr 10 10:37:48 devstack sudo[86806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:48 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.642s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG cinder.manager [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Deleted volume successfully. Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-2ae7f35a-127a-46e2-a46d-f9fc40091f8a req-69197cde-7bb2-44ad-afe5-a6585962f9b6 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "cinder-89bb323b-5a72-47f3-a0b2-d1e250c0c722-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:48 devstack sudo[86803]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1" returned: 0 in 0.638s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-quobyte-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1" released by "delete_volume" :: held 1.356s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Created reservations ['21c8f723-e7ad-4220-9464-4ad8058a6ba7', 'e621d8b1-41b8-42ba-8bd7-82f98e00f429', '6a3d992a-b3d6-431a-af98-caf731b5f1b0', '7a89ed50-522c-4c21-99d4-bdb83f03055e'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:48 devstack sudo[86812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:48 devstack sudo[86812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:49 devstack sudo[86806]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-639d2968-875c-406f-a4b4-59a0fc993369 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3" returned: 0 in 0.696s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:49 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 is being set with open permissions: ugo+rw Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:49 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 Apr 10 10:37:49 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:49 devstack sudo[86812]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.535s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:49 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Deleted volume successfully. Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83d95b4c-2acc-484a-9edf-e05d52196b58 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-19a49c9e-d864-4ea9-a3de-f2ea7baab3a1-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:49 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3" returned: 0 in 0.575s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:49 devstack sudo[86818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.info Apr 10 10:37:49 devstack sudo[86818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "cinder-dcd02f74-15c2-44ba-81ab-ea575c01c5d5-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-dcd02f74-15c2-44ba-81ab-ea575c01c5d5-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "cinder-quobyte-dcd02f74-15c2-44ba-81ab-ea575c01c5d5" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-quobyte-dcd02f74-15c2-44ba-81ab-ea575c01c5d5" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4061552-d6cf-4b9c-bf4d-3782187335e7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Flow 'volume_create_manager' (626b237d-0d8c-476d-89f1-002158ed6c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778a652f-a394-41a1-a1a6-7ef1991fab41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (778a652f-a394-41a1-a1a6-7ef1991fab41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393952353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c91c78e8-2eb5-4784-ab1d-255f409e0de1,host='devstack@QuobyteHD#QuobyteHD',id=711e7f25-717f-44dd-9967-ce7100672d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532a60d4f75a4c629334a0848a9b15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:50Z,use_quota=True,user_id='af5f444e9f7248c5abdbae7d1fea2585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62488b44-0310-40fd-ae94-646f359cb56c),volume_type_id=62488b44-0310-40fd-ae94-646f359cb56c)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eaf3536-3079-4006-a502-5f3a01fbcb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eaf3536-3079-4006-a502-5f3a01fbcb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3979c6-74fd-4249-b1df-6dc074631365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3979c6-74fd-4249-b1df-6dc074631365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711e7f25-717f-44dd-9967-ce7100672d07', 'volume_name': 'volume-711e7f25-717f-44dd-9967-ce7100672d07', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063c835c-5f04-44b9-a05f-fce1d2726474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063c835c-5f04-44b9-a05f-fce1d2726474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affc199a-0c67-45a4-9c2c-8d462c38e5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:50 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Volume 711e7f25-717f-44dd-9967-ce7100672d07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711e7f25-717f-44dd-9967-ce7100672d07', 'volume_size': 1} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:50 devstack sudo[86821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5 Apr 10 10:37:50 devstack sudo[86821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:50 devstack sudo[86818]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.info" returned: 0 in 0.686s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:50 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.info is being set with open permissions: ugo+rw Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:50 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.info Apr 10 10:37:50 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:50 devstack sudo[86821]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5" returned: 0 in 0.731s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:50 devstack sudo[86855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5 Apr 10 10:37:50 devstack sudo[86855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:50 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.info" returned: 0 in 0.544s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.290s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.923s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c91c78e8-2eb5-4784-ab1d-255f409e0de1,created_at=2026-04-10T08:37:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-393952353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c91c78e8-2eb5-4784-ab1d-255f409e0de1,host='devstack@QuobyteHD#QuobyteHD',id=711e7f25-717f-44dd-9967-ce7100672d07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532a60d4f75a4c629334a0848a9b15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:50Z,use_quota=True,user_id='af5f444e9f7248c5abdbae7d1fea2585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62488b44-0310-40fd-ae94-646f359cb56c),volume_type_id=62488b44-0310-40fd-ae94-646f359cb56c)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Creating volume 711e7f25-717f-44dd-9967-ce7100672d07 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:50 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:50 devstack sudo[86858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07 1073741824 Apr 10 10:37:50 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:51 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-65af1bf2-a3ed-4660-a8d8-52363af2a85b tempest-VolumesExtendTest-529048422 None] Create snapshot completed successfully Apr 10 10:37:51 devstack sudo[86855]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-dcd02f74-15c2-44ba-81ab-ea575c01c5d5" returned: 0 in 0.458s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-quobyte-dcd02f74-15c2-44ba-81ab-ea575c01c5d5" released by "delete_volume" :: held 1.249s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Created reservations ['a75ded92-e3e6-4bfd-a53c-92e4fda156ca', '5215e73c-1b1e-46d3-9d8f-209f502d0e5a', 'f9d18150-967d-4bec-8e15-395ebb1bb926', 'f98ba9e1-26d9-43da-9962-5848c09c066f'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:51 devstack sudo[86861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:51 devstack sudo[86861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:51 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07 1073741824" returned: 0 in 0.540s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:51 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07 Apr 10 10:37:51 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:51 devstack sudo[86861]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.557s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:51 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Deleted volume successfully. Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7f9c5037-2230-46f9-afad-5241826b4821 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-dcd02f74-15c2-44ba-81ab-ea575c01c5d5-delete_volume" released by "delete_volume" :: held 1.984s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "cinder-430fcdab-115f-4e8d-92fc-726600092921-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-430fcdab-115f-4e8d-92fc-726600092921-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a89073f0-7040-400a-b15a-9b2344413f1f tempest-VolumesExtendTest-529048422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "cinder-quobyte-430fcdab-115f-4e8d-92fc-726600092921" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-quobyte-430fcdab-115f-4e8d-92fc-726600092921" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bfdbb7-6a1f-4b97-a80b-e0b2544c7452]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:52 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07" returned: 0 in 0.603s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a89073f0-7040-400a-b15a-9b2344413f1f tempest-VolumesExtendTest-529048422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.125s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affc199a-0c67-45a4-9c2c-8d462c38e5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711e7f25-717f-44dd-9967-ce7100672d07', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2ff30c-df7e-4e8e-8ace-ebde821ac42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cdf9d3-9d0f-4cf2-9ad1-9125169490b5]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a89073f0-7040-400a-b15a-9b2344413f1f tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:52 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921 Apr 10 10:37:52 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:52 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Volume volume-711e7f25-717f-44dd-9967-ce7100672d07 (711e7f25-717f-44dd-9967-ce7100672d07): created successfully Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2ff30c-df7e-4e8e-8ace-ebde821ac42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Flow 'volume_create_manager' (626b237d-0d8c-476d-89f1-002158ed6c4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:52 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-cf62b07f-0513-49fc-aeec-83af36324e3e tempest-GroupsTest-788584442 None] Created volume successfully. Apr 10 10:37:52 devstack sudo[86873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 Apr 10 10:37:52 devstack sudo[86873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:52 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921" returned: 0 in 0.573s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:52 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921 Apr 10 10:37:52 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:52 devstack sudo[86873]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a89073f0-7040-400a-b15a-9b2344413f1f tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369" returned: 0 in 0.620s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a89073f0-7040-400a-b15a-9b2344413f1f tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 2G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a89073f0-7040-400a-b15a-9b2344413f1f tempest-VolumesExtendTest-529048422 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 2G" returned: 0 in 0.105s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a89073f0-7040-400a-b15a-9b2344413f1f tempest-VolumesExtendTest-529048422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.759s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:52 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a89073f0-7040-400a-b15a-9b2344413f1f tempest-VolumesExtendTest-529048422 None] Extend volume completed successfully. Apr 10 10:37:53 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-430fcdab-115f-4e8d-92fc-726600092921" returned: 0 in 0.515s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-quobyte-430fcdab-115f-4e8d-92fc-726600092921" released by "delete_volume" :: held 1.125s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Created reservations ['53313994-7f95-4433-9795-7965a6aca859', '8e060392-9b5b-4a6f-8c32-ee2403b5364a', '46673fe9-9a07-45b6-aa7d-76f1c58e8bdd', '8b85aecd-d91d-4124-8d7f-2e2386537b97'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Acquiring lock "cinder-64465fee-6f6a-48bf-a4c8-f864aee56fd3-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Lock "cinder-64465fee-6f6a-48bf-a4c8-f864aee56fd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Acquiring lock "cinder-quobyte-639d2968-875c-406f-a4b4-59a0fc993369" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Lock "cinder-quobyte-639d2968-875c-406f-a4b4-59a0fc993369" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Acquiring lock "cinder-quobyte-64465fee-6f6a-48bf-a4c8-f864aee56fd3" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Lock "cinder-quobyte-64465fee-6f6a-48bf-a4c8-f864aee56fd3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Deleting offline snapshot 64465fee-6f6a-48bf-a4c8-f864aee56fd3 of volume 639d2968-875c-406f-a4b4-59a0fc993369 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] snapshot_file for this snap is: volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9d21d4-3bc5-41ba-81a9-60200108dbb6]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:53 devstack sudo[86889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:53 devstack sudo[86889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:53 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 Apr 10 10:37:53 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Acquiring lock "cinder-quobyte-711e7f25-717f-44dd-9967-ce7100672d07" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Lock "cinder-quobyte-711e7f25-717f-44dd-9967-ce7100672d07" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2c661d-1304-4cf6-820d-470c001938ff]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:53 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07 Apr 10 10:37:53 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:53 devstack sudo[86889]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.562s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:53 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Deleted volume successfully. Apr 10 10:37:53 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3" returned: 0 in 0.624s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-639d2968-875c-406f-a4b4-59a0fc993369(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3476b4c3-1767-4c49-829c-25cc974116f5 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-430fcdab-115f-4e8d-92fc-726600092921-delete_volume" released by "delete_volume" :: held 1.979s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce8741-8514-4105-b3de-585766a977a9]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:54 devstack sudo[86898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 Apr 10 10:37:54 devstack sudo[86898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "cinder-1c5d7855-d78c-4051-bcb2-2818e2449b76-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-1c5d7855-d78c-4051-bcb2-2818e2449b76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "cinder-quobyte-1c5d7855-d78c-4051-bcb2-2818e2449b76" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-quobyte-1c5d7855-d78c-4051-bcb2-2818e2449b76" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[786dadbf-3840-4a90-a220-5b53f35d8d8c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:54 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07" returned: 0 in 0.636s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:54 devstack sudo[86904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07 Apr 10 10:37:54 devstack sudo[86904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:54 devstack sudo[86903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76 Apr 10 10:37:54 devstack sudo[86903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:54 devstack sudo[86898]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369" returned: 0 in 0.595s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:54 devstack sudo[86910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 Apr 10 10:37:54 devstack sudo[86910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:54 devstack sudo[86903]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76" returned: 0 in 0.576s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:54 devstack sudo[86904]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-711e7f25-717f-44dd-9967-ce7100672d07" returned: 0 in 0.547s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:54 devstack sudo[86916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76 Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Lock "cinder-quobyte-711e7f25-717f-44dd-9967-ce7100672d07" released by "delete_volume" :: held 1.209s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:54 devstack sudo[86916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Created reservations ['a3aa5e9e-1d39-41e7-aa78-7f9495309592'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:54 devstack cinder-volume[82038]: WARNING cinder.quota [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1819448144 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1819448144, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:37:54 devstack cinder-volume[82038]: WARNING cinder.quota [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1819448144 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1819448144, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:37:54 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Created reservations ['1350920a-8f3b-4fca-8d7a-a5d838fbb41b', 'ed2e9da9-db28-44d6-ac86-44623f24bb70', '988fa61f-f234-4fdd-9b57-27ccf97ee809', 'f0f5f2bc-a9c9-48b8-a431-0a22d0c71922'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:55 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:55 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:55 devstack sudo[86910]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3" returned: 0 in 0.595s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:55 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3 Apr 10 10:37:55 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:55 devstack sudo[86916]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-1c5d7855-d78c-4051-bcb2-2818e2449b76" returned: 0 in 0.461s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-quobyte-1c5d7855-d78c-4051-bcb2-2818e2449b76" released by "delete_volume" :: held 1.076s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Created reservations ['84310904-2d89-4099-bde8-ad69f50262b8', '09904b41-a531-4a05-aa2e-ade6d2e18110', 'b7357cc1-5e91-42e0-9e5b-f6ee9a709c8a', '797bab67-2121-440d-a017-515190d99910'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:55 devstack sudo[86927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:55 devstack sudo[86927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:55 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.462s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:55 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4b577861-1f9b-48de-b87b-ab35e74dc335 tempest-GroupsTest-788584442 None] Delete group completed successfully. Apr 10 10:37:55 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369.64465fee-6f6a-48bf-a4c8-f864aee56fd3" returned: 0 in 0.463s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Lock "cinder-quobyte-64465fee-6f6a-48bf-a4c8-f864aee56fd3" released by "_delete_snapshot" :: held 2.362s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Lock "cinder-quobyte-639d2968-875c-406f-a4b4-59a0fc993369" released by "delete_snapshot" :: held 2.381s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Created reservations ['02c133b6-3e02-4bef-9da5-907a6ac6dc5a', 'f36fa0bb-3206-4819-8996-b37a27f3320b', 'ae05e659-5ac4-41fa-81a0-f291f5198359', 'd270b3fe-1dce-438e-a151-747c34282868'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:55 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Delete snapshot completed successfully. Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-63966349-34c1-4425-8e4e-1bef2ec1ae24 tempest-VolumesExtendTest-529048422 None] Lock "cinder-64465fee-6f6a-48bf-a4c8-f864aee56fd3-delete_snapshot" released by "delete_snapshot" :: held 2.471s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:55 devstack sudo[86927]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.466s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:55 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Deleted volume successfully. Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d199f5dd-37ac-43d9-9140-9657d2119bc2 tempest-CreateVolumesFromImageTest-2080362665 None] Lock "cinder-1c5d7855-d78c-4051-bcb2-2818e2449b76-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-74d4dcbb-f392-40ef-ad22-c7bd57ca70de tempest-GroupsTest-788584442 None] Created reservations ['06ae101e-22c3-4e8b-a10a-6441d3127e7a'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-74d4dcbb-f392-40ef-ad22-c7bd57ca70de tempest-GroupsTest-788584442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-74d4dcbb-f392-40ef-ad22-c7bd57ca70de tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-74d4dcbb-f392-40ef-ad22-c7bd57ca70de tempest-GroupsTest-788584442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-74d4dcbb-f392-40ef-ad22-c7bd57ca70de tempest-GroupsTest-788584442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-74d4dcbb-f392-40ef-ad22-c7bd57ca70de tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-74d4dcbb-f392-40ef-ad22-c7bd57ca70de tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:56 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:56 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Acquiring lock "cinder-639d2968-875c-406f-a4b4-59a0fc993369-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:56 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Lock "cinder-639d2968-875c-406f-a4b4-59a0fc993369-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-74d4dcbb-f392-40ef-ad22-c7bd57ca70de tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.603s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-74d4dcbb-f392-40ef-ad22-c7bd57ca70de tempest-GroupsTest-788584442 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:56 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-74d4dcbb-f392-40ef-ad22-c7bd57ca70de tempest-GroupsTest-788584442 None] Delete group completed successfully. Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Acquiring lock "cinder-quobyte-639d2968-875c-406f-a4b4-59a0fc993369" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Lock "cinder-quobyte-639d2968-875c-406f-a4b4-59a0fc993369" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f2ce97-e804-46b4-bdfd-f18bdcc31b1c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:37:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:56 devstack sudo[86934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 Apr 10 10:37:56 devstack sudo[86934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:57 devstack sudo[86934]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369" returned: 0 in 0.809s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:57 devstack sudo[86946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369 Apr 10 10:37:57 devstack sudo[86946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:57 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b0be4fc1-3006-4cbf-b713-8ca0ec1edd32 tempest-GroupsTest-788584442 None] Group tempest-GroupsTest-Group-1287851887: creating Apr 10 10:37:57 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b0be4fc1-3006-4cbf-b713-8ca0ec1edd32 tempest-GroupsTest-788584442 None] Group tempest-GroupsTest-Group-1287851887: created successfully Apr 10 10:37:57 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b0be4fc1-3006-4cbf-b713-8ca0ec1edd32 tempest-GroupsTest-788584442 None] Create group completed successfully. Apr 10 10:37:58 devstack sudo[86946]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-639d2968-875c-406f-a4b4-59a0fc993369" returned: 0 in 0.609s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:58 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Lock "cinder-quobyte-639d2968-875c-406f-a4b4-59a0fc993369" released by "delete_volume" :: held 1.462s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:58 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Created reservations ['42ce0ed0-b25a-4eb9-9e37-82d0a6609b5d', '783d2229-4468-4342-a792-11449e68e070', '07afe790-75b1-4eef-be5e-de6ea9eef2d2', '86bed40c-bbf1-4fce-b288-acad14edb7aa'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:37:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:58 devstack sudo[86965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:37:58 devstack sudo[86965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:58 devstack sudo[86965]: pam_unix(sudo:session): session closed for user root Apr 10 10:37:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.678s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:37:59 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Deleted volume successfully. Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-56cb00e2-4662-4d9b-9126-a51302358efd tempest-VolumesExtendTest-529048422 None] Lock "cinder-639d2968-875c-406f-a4b4-59a0fc993369-delete_volume" released by "delete_volume" :: held 2.432s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Flow 'volume_create_manager' (63317de8-b907-4d77-b1a4-9271905a1a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1204ad65-2b7d-446c-be93-4779db386f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1204ad65-2b7d-446c-be93-4779db386f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1231094062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ad38231-83e5-4fe0-acfa-dd853f15bc5c,host='devstack@QuobyteHD#QuobyteHD',id=e8a6726e-af12-41d2-8c65-a23fea4d2105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532a60d4f75a4c629334a0848a9b15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:59Z,use_quota=True,user_id='af5f444e9f7248c5abdbae7d1fea2585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c2eb385-c5bb-4a79-9fbb-b334548d89f7),volume_type_id=9c2eb385-c5bb-4a79-9fbb-b334548d89f7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98335f3-978a-4083-8548-92b466b9b41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c98335f3-978a-4083-8548-92b466b9b41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536b0845-99a6-4e8f-8d70-fc8924db09e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (536b0845-99a6-4e8f-8d70-fc8924db09e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8a6726e-af12-41d2-8c65-a23fea4d2105', 'volume_name': 'volume-e8a6726e-af12-41d2-8c65-a23fea4d2105', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44704192-355f-44c4-9a1a-64a8200cc277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44704192-355f-44c4-9a1a-64a8200cc277) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32d956b-1ed7-4f77-b44c-f3630717a255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Volume e8a6726e-af12-41d2-8c65-a23fea4d2105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8a6726e-af12-41d2-8c65-a23fea4d2105', 'volume_size': 1} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ad38231-83e5-4fe0-acfa-dd853f15bc5c,created_at=2026-04-10T08:37:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1231094062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ad38231-83e5-4fe0-acfa-dd853f15bc5c,host='devstack@QuobyteHD#QuobyteHD',id=e8a6726e-af12-41d2-8c65-a23fea4d2105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532a60d4f75a4c629334a0848a9b15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:37:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:37:59Z,use_quota=True,user_id='af5f444e9f7248c5abdbae7d1fea2585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c2eb385-c5bb-4a79-9fbb-b334548d89f7),volume_type_id=9c2eb385-c5bb-4a79-9fbb-b334548d89f7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Creating volume e8a6726e-af12-41d2-8c65-a23fea4d2105 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:37:59 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:37:59 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105 1073741824 Apr 10 10:37:59 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (21a7bcc1-da37-4105-8b89-ca4c0bcf1738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357b958a-cdf9-47ea-97dd-4cb52f809350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357b958a-cdf9-47ea-97dd-4cb52f809350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883342980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360a8d53-dc35-4e77-b34b-1ecb16389d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:00Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311efa80-a3f1-4ac1-8ace-f6c6a483f72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (311efa80-a3f1-4ac1-8ace-f6c6a483f72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b727d6-3051-4356-942d-6f7f320406f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97b727d6-3051-4356-942d-6f7f320406f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '360a8d53-dc35-4e77-b34b-1ecb16389d25', 'volume_name': 'volume-360a8d53-dc35-4e77-b34b-1ecb16389d25', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ea50a6-872e-4569-9e85-83c3f6a6cbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6ea50a6-872e-4569-9e85-83c3f6a6cbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b92d6d1-5a62-49a3-abd6-49412cab4eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:37:59 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume 360a8d53-dc35-4e77-b34b-1ecb16389d25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-360a8d53-dc35-4e77-b34b-1ecb16389d25', 'volume_size': 1} Apr 10 10:37:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:00 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105 1073741824" returned: 0 in 0.735s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:00 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105 Apr 10 10:38:00 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:00 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105" returned: 0 in 0.573s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] <== create_volume: return (1353ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.356s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.725s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-883342980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=360a8d53-dc35-4e77-b34b-1ecb16389d25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:00Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Creating volume 360a8d53-dc35-4e77-b34b-1ecb16389d25 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:00 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:00 devstack sudo[87012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25 1073741824 Apr 10 10:38:00 devstack sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e32d956b-1ed7-4f77-b44c-f3630717a255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8a6726e-af12-41d2-8c65-a23fea4d2105', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d7b0ca1-3745-4f06-be76-499e15e0aac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:00 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Volume volume-e8a6726e-af12-41d2-8c65-a23fea4d2105 (e8a6726e-af12-41d2-8c65-a23fea4d2105): created successfully Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d7b0ca1-3745-4f06-be76-499e15e0aac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Flow 'volume_create_manager' (63317de8-b907-4d77-b1a4-9271905a1a74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:00 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-48c5fbf5-d5eb-4b8b-987f-91246a88b2e7 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Terminate volume connection completed successfully. Apr 10 10:38:00 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-48c5fbf5-d5eb-4b8b-987f-91246a88b2e7 tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Deleting attachment a2a067ef-fcd8-4696-9a53-2bde19f7d1f0. {{(pid=82038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 10:38:00 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-3dd15a64-559b-45f4-8481-97aa208536d9 tempest-GroupsTest-788584442 None] Created volume successfully. Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "cinder-52a5aeb4-9e20-4100-b86d-5a47269ec3a6-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:01 devstack sudo[87012]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25 1073741824" returned: 0 in 0.757s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "cinder-52a5aeb4-9e20-4100-b86d-5a47269ec3a6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "cinder-quobyte-52a5aeb4-9e20-4100-b86d-5a47269ec3a6" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "cinder-quobyte-52a5aeb4-9e20-4100-b86d-5a47269ec3a6" acquired by "delete_volume" :: waited 0.023s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b8ae0-9236-4744-9a0e-ed5561ee912a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:01 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25 Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:01 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:01 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 Apr 10 10:38:01 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Flow 'volume_create_manager' (64d83ce9-4c8f-4f6c-8510-b68511f1d57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b181fbd9-34dc-4957-9f9d-0bcc99f465dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b181fbd9-34dc-4957-9f9d-0bcc99f465dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-467394671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c8eeee-6ed9-4371-a3ab-97986c39d5be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39fdc1d2f4cc49cdb0856e0fc63e6df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:02Z,use_quota=True,user_id='da6727fdc4fb4d8b905eea567f3427d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67e06d3-af93-45b9-9906-c7cfc599b815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a67e06d3-af93-45b9-9906-c7cfc599b815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c76b7e-ecfa-4f35-b0ad-c2d33893f648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82c76b7e-ecfa-4f35-b0ad-c2d33893f648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20c8eeee-6ed9-4371-a3ab-97986c39d5be', 'volume_name': 'volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c531e5-1607-47c5-a1ca-abed313c82c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c531e5-1607-47c5-a1ca-abed313c82c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e419ec3b-84f1-4414-8380-b8010b556c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:01 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Volume 20c8eeee-6ed9-4371-a3ab-97986c39d5be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be', 'volume_size': 1} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:01 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Flow 'volume_create_manager' (8e1451e4-08b4-44e9-a954-593dc606c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c50c81-8145-4e72-99c3-b642f64d2252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3c50c81-8145-4e72-99c3-b642f64d2252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-98760421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ad38231-83e5-4fe0-acfa-dd853f15bc5c,host='devstack@QuobyteHD#QuobyteHD',id=f73e78b7-92bb-4cf8-8502-aa175f6d7cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532a60d4f75a4c629334a0848a9b15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:02Z,use_quota=True,user_id='af5f444e9f7248c5abdbae7d1fea2585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c2eb385-c5bb-4a79-9fbb-b334548d89f7),volume_type_id=9c2eb385-c5bb-4a79-9fbb-b334548d89f7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20febac-2cf9-4df5-9671-05318686a641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a20febac-2cf9-4df5-9671-05318686a641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c59ce98-1ca5-4fcd-8359-5c6a66873da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c59ce98-1ca5-4fcd-8359-5c6a66873da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f73e78b7-92bb-4cf8-8502-aa175f6d7cb4', 'volume_name': 'volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cc134e-ff91-4d6c-b783-53efabcd1a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cc134e-ff91-4d6c-b783-53efabcd1a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3d1dc5-0e2a-4972-9f02-351dd53f2f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:02 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Volume f73e78b7-92bb-4cf8-8502-aa175f6d7cb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4', 'volume_size': 1} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:02 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25" returned: 0 in 0.649s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.169s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-467394671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20c8eeee-6ed9-4371-a3ab-97986c39d5be,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39fdc1d2f4cc49cdb0856e0fc63e6df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:02Z,use_quota=True,user_id='da6727fdc4fb4d8b905eea567f3427d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Creating volume 20c8eeee-6ed9-4371-a3ab-97986c39d5be {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:02 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b92d6d1-5a62-49a3-abd6-49412cab4eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-360a8d53-dc35-4e77-b34b-1ecb16389d25', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0870646d-8219-4cf5-875e-07169d057914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:02 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be 1073741824 Apr 10 10:38:02 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:02 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume volume-360a8d53-dc35-4e77-b34b-1ecb16389d25 (360a8d53-dc35-4e77-b34b-1ecb16389d25): created successfully Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0870646d-8219-4cf5-875e-07169d057914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (21a7bcc1-da37-4105-8b89-ca4c0bcf1738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:02 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-74f4ff54-0360-40a2-9cc9-28fd74dcbf5b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created volume successfully. Apr 10 10:38:02 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6" returned: 0 in 0.715s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:02 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6 Apr 10 10:38:02 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:02 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-52a5aeb4-9e20-4100-b86d-5a47269ec3a6" returned: 0 in 0.539s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "cinder-quobyte-52a5aeb4-9e20-4100-b86d-5a47269ec3a6" released by "delete_volume" :: held 1.292s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.quota [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Created reservations ['8a3aa440-b6ab-46bc-8afc-9d702dc527e0', '744a9662-c356-40e4-b723-97f2f28b0890', '94ad0e1c-a44d-4388-a304-7225ff2988bc', 'cbdb2120-0959-4c60-9dfa-7655605f9b2d'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:02 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be 1073741824" returned: 0 in 0.724s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:02 devstack sudo[87035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be Apr 10 10:38:02 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:02 devstack sudo[87037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:02 devstack sudo[87037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (33b80930-248b-4681-a01c-a50e3b1e4310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cc6e10-d7f1-4e43-a78c-32fc5fabe434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32cc6e10-d7f1-4e43-a78c-32fc5fabe434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859232867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf202fd0-8abf-44fe-b3bd-731eb35c4772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:03Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e0fcf8-5589-4ef4-be8b-57439049ecdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47e0fcf8-5589-4ef4-be8b-57439049ecdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5682db2-b47a-4452-8df5-e1c4cf4bbd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5682db2-b47a-4452-8df5-e1c4cf4bbd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf202fd0-8abf-44fe-b3bd-731eb35c4772', 'volume_name': 'volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a1cbf5-c3b5-4bf4-be04-67cfac8e5265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62a1cbf5-c3b5-4bf4-be04-67cfac8e5265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047568fc-85ec-4db0-86aa-130ec5aeb216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume bf202fd0-8abf-44fe-b3bd-731eb35c4772: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772', 'volume_size': 1} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:03 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be" returned: 0 in 0.628s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.500s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1ad38231-83e5-4fe0-acfa-dd853f15bc5c,created_at=2026-04-10T08:38:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-98760421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1ad38231-83e5-4fe0-acfa-dd853f15bc5c,host='devstack@QuobyteHD#QuobyteHD',id=f73e78b7-92bb-4cf8-8502-aa175f6d7cb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='532a60d4f75a4c629334a0848a9b15a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:02Z,use_quota=True,user_id='af5f444e9f7248c5abdbae7d1fea2585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9c2eb385-c5bb-4a79-9fbb-b334548d89f7),volume_type_id=9c2eb385-c5bb-4a79-9fbb-b334548d89f7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Creating volume f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:03 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e419ec3b-84f1-4414-8380-b8010b556c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299cdbbb-bc96-4517-97d2-312c0eb68312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack sudo[87043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 1073741824 Apr 10 10:38:03 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:03 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Volume volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be (20c8eeee-6ed9-4371-a3ab-97986c39d5be): created successfully Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (299cdbbb-bc96-4517-97d2-312c0eb68312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Flow 'volume_create_manager' (64d83ce9-4c8f-4f6c-8510-b68511f1d57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:03 devstack sudo[87037]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (4943e618-f9ff-4b6c-b822-f9efffe79210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef5cf68-46a8-41e7-81cb-98809da7af90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.744s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.manager [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:03 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-10995b2f-08ae-4902-8a29-f63f7504a205 tempest-VolumesListTestJSON-83175647 None] Created volume successfully. Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ef5cf68-46a8-41e7-81cb-98809da7af90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-904922134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25a8599-67de-4ad2-b7b6-c6474beaba05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:04Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3310e19-766d-4b59-9248-86705c8fea5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3310e19-766d-4b59-9248-86705c8fea5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b550b378-80ee-4b0c-a0f3-ff71deb3e4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b550b378-80ee-4b0c-a0f3-ff71deb3e4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e25a8599-67de-4ad2-b7b6-c6474beaba05', 'volume_name': 'volume-e25a8599-67de-4ad2-b7b6-c6474beaba05', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945c7e2a-7bac-4479-91fd-c98590cc9790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945c7e2a-7bac-4479-91fd-c98590cc9790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e61e4fe-6e2a-4fcc-ba56-3a33355aac83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume e25a8599-67de-4ad2-b7b6-c6474beaba05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e25a8599-67de-4ad2-b7b6-c6474beaba05', 'volume_size': 1} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:03 devstack cinder-volume[82038]: INFO cinder.volume.manager [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Deleted volume successfully. Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [req-41b1c4dd-5802-4880-bcaf-9dc9beca330f req-033d6f28-b9fe-41f7-bb05-da924b6344cd tempest-ServerBootFromVolumeStableRescueTest-835379547 None] Lock "cinder-52a5aeb4-9e20-4100-b86d-5a47269ec3a6-delete_volume" released by "delete_volume" :: held 2.344s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (93210446-c26a-439d-9598-524fce23e13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1e2df8-4bb2-4e23-aa28-f87c06b69153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1e2df8-4bb2-4e23-aa28-f87c06b69153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-761146789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa6f470-f880-43bf-8c62-e7e338d0a9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:04Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6afafb-9580-4995-842c-797ed3844023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb6afafb-9580-4995-842c-797ed3844023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4da5a8-bd1c-4c81-958a-61567efb69cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4da5a8-bd1c-4c81-958a-61567efb69cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aa6f470-f880-43bf-8c62-e7e338d0a9f6', 'volume_name': 'volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea79dcba-a493-4f0a-80e0-ff29bfe8c278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea79dcba-a493-4f0a-80e0-ff29bfe8c278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1a2c46-ee11-49cb-bb69-5bc44790c06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:03 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume 7aa6f470-f880-43bf-8c62-e7e338d0a9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6', 'volume_size': 1} Apr 10 10:38:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (23572e8e-a8af-47ff-9c93-a332df93339d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddc1d02-4ebd-4584-8456-37a240326a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ddc1d02-4ebd-4584-8456-37a240326a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1324411387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605de705-24ec-4830-8fee-a7b3388e2b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:04Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2a692d-71b8-457f-bed4-e96e851469e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb2a692d-71b8-457f-bed4-e96e851469e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e5e8ab-8c71-4247-a547-c1b74062e465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e5e8ab-8c71-4247-a547-c1b74062e465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '605de705-24ec-4830-8fee-a7b3388e2b5b', 'volume_name': 'volume-605de705-24ec-4830-8fee-a7b3388e2b5b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891741f3-0d2b-4e08-a8e2-6bfc910d88c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891741f3-0d2b-4e08-a8e2-6bfc910d88c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c450dd-3928-49fa-88e3-410e3c1e276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume 605de705-24ec-4830-8fee-a7b3388e2b5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-605de705-24ec-4830-8fee-a7b3388e2b5b', 'volume_size': 1} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:04 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 1073741824" returned: 0 in 0.810s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:04 devstack sudo[87048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 Apr 10 10:38:04 devstack sudo[87048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Flow 'volume_create_manager' (719b509c-5f58-4136-82ca-6cd65a7be138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b858cc9-466e-4025-99a6-408ea52a58a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b858cc9-466e-4025-99a6-408ea52a58a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-150811356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63769884-a6fd-425c-a95c-5fe3002397c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39fdc1d2f4cc49cdb0856e0fc63e6df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:04Z,use_quota=True,user_id='da6727fdc4fb4d8b905eea567f3427d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b294860-3d9f-469c-be67-786872b19cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b294860-3d9f-469c-be67-786872b19cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1832b0b-5af0-4413-8ba0-a5e207e675ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1832b0b-5af0-4413-8ba0-a5e207e675ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63769884-a6fd-425c-a95c-5fe3002397c8', 'volume_name': 'volume-63769884-a6fd-425c-a95c-5fe3002397c8', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdf92fa-8c20-4fb5-a63d-59222071a582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fdf92fa-8c20-4fb5-a63d-59222071a582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba03818b-62f6-46e9-b243-1f17dc1f3d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Volume 63769884-a6fd-425c-a95c-5fe3002397c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63769884-a6fd-425c-a95c-5fe3002397c8', 'volume_size': 1} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (9ef16fd3-3a3a-48c3-90d8-604df0d618d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9363de-2bfa-4b55-a86f-3fabb8c3108c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec9363de-2bfa-4b55-a86f-3fabb8c3108c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-785292479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d183b27-fd9c-4054-a2e9-91ff5d18b425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:05Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a4cc20b-2521-49e4-88e4-07a1c7d8950d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a4cc20b-2521-49e4-88e4-07a1c7d8950d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b02216-8a33-45da-aa7f-822409a8866e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90b02216-8a33-45da-aa7f-822409a8866e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d183b27-fd9c-4054-a2e9-91ff5d18b425', 'volume_name': 'volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cb403f-4437-45e5-b6f0-5756a04c2be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cb403f-4437-45e5-b6f0-5756a04c2be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15fdfe8-7acc-4314-b4aa-be32c05fb395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:04 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume 6d183b27-fd9c-4054-a2e9-91ff5d18b425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425', 'volume_size': 1} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:04 devstack sudo[87048]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4" returned: 0 in 0.575s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.602s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1859232867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf202fd0-8abf-44fe-b3bd-731eb35c4772,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:03Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Creating volume bf202fd0-8abf-44fe-b3bd-731eb35c4772 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:05 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d3d1dc5-0e2a-4972-9f02-351dd53f2f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014ec990-2a5c-4a6c-85ad-c4489ca88d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:05 devstack sudo[87051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772 1073741824 Apr 10 10:38:05 devstack sudo[87051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:05 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Volume volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 (f73e78b7-92bb-4cf8-8502-aa175f6d7cb4): created successfully Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014ec990-2a5c-4a6c-85ad-c4489ca88d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Flow 'volume_create_manager' (8e1451e4-08b4-44e9-a954-593dc606c200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:05 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-29d9f61b-cb3f-4195-a753-df4c9ab2f9bc tempest-GroupsTest-788584442 None] Created volume successfully. Apr 10 10:38:05 devstack sudo[87051]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772 1073741824" returned: 0 in 0.552s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:05 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772 Apr 10 10:38:05 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:06 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772" returned: 0 in 0.480s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.325s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-904922134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e25a8599-67de-4ad2-b7b6-c6474beaba05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:04Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Creating volume e25a8599-67de-4ad2-b7b6-c6474beaba05 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.062s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:06 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047568fc-85ec-4db0-86aa-130ec5aeb216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4f3b27-90c1-4622-bf2d-7db769e2642e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:06 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772 (bf202fd0-8abf-44fe-b3bd-731eb35c4772): created successfully Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4f3b27-90c1-4622-bf2d-7db769e2642e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:06 devstack sudo[87083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05 1073741824 Apr 10 10:38:06 devstack sudo[87083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (33b80930-248b-4681-a01c-a50e3b1e4310) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:06 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-da2d7539-64dc-4336-bbe3-45f543214ba5 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created volume successfully. Apr 10 10:38:06 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4eb49b9b-2c1a-4709-8af3-28a312b7edd8 tempest-GroupsTest-788584442 None] Update group completed successfully. Apr 10 10:38:06 devstack sudo[87083]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05 1073741824" returned: 0 in 0.703s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:06 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05 Apr 10 10:38:06 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05" returned: 0 in 0.445s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.239s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.371s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-761146789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7aa6f470-f880-43bf-8c62-e7e338d0a9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:04Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Creating volume 7aa6f470-f880-43bf-8c62-e7e338d0a9f6 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:07 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e61e4fe-6e2a-4fcc-ba56-3a33355aac83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e25a8599-67de-4ad2-b7b6-c6474beaba05', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack sudo[87092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6 1073741824 Apr 10 10:38:07 devstack sudo[87092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afa34df-5aa1-426d-8e05-ddb859eae511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:07 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume volume-e25a8599-67de-4ad2-b7b6-c6474beaba05 (e25a8599-67de-4ad2-b7b6-c6474beaba05): created successfully Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7afa34df-5aa1-426d-8e05-ddb859eae511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (4943e618-f9ff-4b6c-b822-f9efffe79210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:07 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-580895d2-03dc-4d3f-bccf-2372030749dc tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created volume successfully. Apr 10 10:38:07 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-1983bb6b-c37f-41e4-8fad-2af4d8f42bf7 tempest-GroupsTest-788584442 None] Update group completed successfully. Apr 10 10:38:07 devstack sudo[87092]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6 1073741824" returned: 0 in 0.644s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:08 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6 Apr 10 10:38:08 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:08 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6" returned: 0 in 0.428s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.063s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1324411387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=605de705-24ec-4830-8fee-a7b3388e2b5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:04Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Creating volume 605de705-24ec-4830-8fee-a7b3388e2b5b {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:08 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea1a2c46-ee11-49cb-bb69-5bc44790c06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3623da11-9076-4dc6-9c63-32f33c344a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:08 devstack sudo[87101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b 1073741824 Apr 10 10:38:08 devstack sudo[87101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:08 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6 (7aa6f470-f880-43bf-8c62-e7e338d0a9f6): created successfully Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3623da11-9076-4dc6-9c63-32f33c344a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (93210446-c26a-439d-9598-524fce23e13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:08 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c37a8fd9-4fa7-4f99-b755-2582f5ea3a8c tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created volume successfully. Apr 10 10:38:09 devstack sudo[87101]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b 1073741824" returned: 0 in 0.581s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:09 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b Apr 10 10:38:09 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Acquiring lock "cinder-quobyte-e8a6726e-af12-41d2-8c65-a23fea4d2105" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Lock "cinder-quobyte-e8a6726e-af12-41d2-8c65-a23fea4d2105" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e95ede-e68a-4738-ae14-d71eede13d34]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:09 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105 Apr 10 10:38:09 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:09 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b" returned: 0 in 0.455s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.904s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-150811356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63769884-a6fd-425c-a95c-5fe3002397c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39fdc1d2f4cc49cdb0856e0fc63e6df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:04Z,use_quota=True,user_id='da6727fdc4fb4d8b905eea567f3427d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Creating volume 63769884-a6fd-425c-a95c-5fe3002397c8 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:09 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:09 devstack sudo[87111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8 1073741824 Apr 10 10:38:09 devstack sudo[87111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50c450dd-3928-49fa-88e3-410e3c1e276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-605de705-24ec-4830-8fee-a7b3388e2b5b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd4cfa6-29ff-4361-9b62-728e899db7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:09 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume volume-605de705-24ec-4830-8fee-a7b3388e2b5b (605de705-24ec-4830-8fee-a7b3388e2b5b): created successfully Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd4cfa6-29ff-4361-9b62-728e899db7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (23572e8e-a8af-47ff-9c93-a332df93339d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:09 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b2e76e31-fda3-4939-b6f7-380c2c4c8df9 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created volume successfully. Apr 10 10:38:09 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105" returned: 0 in 0.526s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:09 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105 Apr 10 10:38:09 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:10 devstack sudo[87111]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8 1073741824" returned: 0 in 0.580s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:10 devstack sudo[87122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8 Apr 10 10:38:10 devstack sudo[87122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:10 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e8a6726e-af12-41d2-8c65-a23fea4d2105" returned: 0 in 0.553s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Lock "cinder-quobyte-e8a6726e-af12-41d2-8c65-a23fea4d2105" released by "delete_volume" :: held 1.106s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Acquiring lock "cinder-quobyte-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Lock "cinder-quobyte-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a9978c-5d49-48d2-8686-2cd58ffde59e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:10 devstack sudo[87124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 Apr 10 10:38:10 devstack sudo[87124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:10 devstack sudo[87122]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8" returned: 0 in 0.469s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.892s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-785292479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d183b27-fd9c-4054-a2e9-91ff5d18b425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='162f340c8901495ea3c9cbb13df1746d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:05Z,use_quota=True,user_id='def7087e84eb442aa6d4625445e9c84e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Creating volume 6d183b27-fd9c-4054-a2e9-91ff5d18b425 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:10 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba03818b-62f6-46e9-b243-1f17dc1f3d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63769884-a6fd-425c-a95c-5fe3002397c8', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:10 devstack sudo[87127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425 1073741824 Apr 10 10:38:10 devstack sudo[87127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b02712-9d4f-4216-84cb-768af77a8365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:10 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Volume volume-63769884-a6fd-425c-a95c-5fe3002397c8 (63769884-a6fd-425c-a95c-5fe3002397c8): created successfully Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37b02712-9d4f-4216-84cb-768af77a8365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Flow 'volume_create_manager' (719b509c-5f58-4136-82ca-6cd65a7be138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:10 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-83228840-655a-464b-8c92-751767066a9d tempest-VolumesListTestJSON-83175647 None] Created volume successfully. Apr 10 10:38:10 devstack sudo[87124]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4" returned: 0 in 0.555s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:10 devstack sudo[87132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4 Apr 10 10:38:10 devstack sudo[87132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:11 devstack sudo[87127]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Flow 'volume_create_manager' (f6231857-7cd0-4342-805a-b376a2878efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7929d060-cced-4e24-9966-a883d73cac0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7929d060-cced-4e24-9966-a883d73cac0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1191073293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39fdc1d2f4cc49cdb0856e0fc63e6df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:11Z,use_quota=True,user_id='da6727fdc4fb4d8b905eea567f3427d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d44228e-2023-4c22-a376-a2393d969f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d44228e-2023-4c22-a376-a2393d969f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a3733c-010a-4587-8558-b8823e941312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a3733c-010a-4587-8558-b8823e941312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0', 'volume_name': 'volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d82088-49c1-4f7a-be60-94bb004aea22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0d82088-49c1-4f7a-be60-94bb004aea22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce24d483-a734-49db-bb9c-6b2095782462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:11 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Volume c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0', 'volume_size': 1} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425 1073741824" returned: 0 in 0.759s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:11 devstack sudo[87132]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4" returned: 0 in 0.581s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Lock "cinder-quobyte-f73e78b7-92bb-4cf8-8502-aa175f6d7cb4" released by "delete_volume" :: held 1.168s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:11 devstack sudo[87138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425 Apr 10 10:38:11 devstack sudo[87138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Created reservations ['0c302b11-b346-41a1-9a2e-5a3cf314f681'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:11 devstack cinder-volume[82038]: WARNING cinder.quota [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-459149004 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-459149004, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:38:11 devstack cinder-volume[82038]: WARNING cinder.quota [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-459149004 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-459149004, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Created reservations ['fa360302-9206-4cb8-b3ec-42572dc86ec6', '2b5fa819-4fcb-45ee-a753-4423d5223989', '9964c712-6063-452f-97c0-976349dd1343', '7a07f19f-f5c4-4390-8001-176ffe60f1e8'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Created reservations ['95abfca7-4623-4df6-b0c6-fd33d98b0639', '9481e872-1527-493c-be8d-356e185dd2eb', '7638c87c-ad8f-44cf-9166-752ff9391b7c', 'a28c56b8-d038-4056-990a-2d84843c7a11'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:11 devstack sudo[87140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:11 devstack sudo[87140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:11 devstack sudo[87138]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425" returned: 0 in 0.599s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] <== create_volume: return (1389ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1191073293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='39fdc1d2f4cc49cdb0856e0fc63e6df2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:11Z,use_quota=True,user_id='da6727fdc4fb4d8b905eea567f3427d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Creating volume c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:12 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:12 devstack sudo[87144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 1073741824 Apr 10 10:38:12 devstack sudo[87144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a15fdfe8-7acc-4314-b4aa-be32c05fb395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa275c6-76b8-4d5e-9e88-483a1c7403a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:12 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Volume volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425 (6d183b27-fd9c-4054-a2e9-91ff5d18b425): created successfully Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa275c6-76b8-4d5e-9e88-483a1c7403a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Flow 'volume_create_manager' (9ef16fd3-3a3a-48c3-90d8-604df0d618d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:12 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b3c0dbff-57f9-45ba-ad80-4cefe078842b tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created volume successfully. Apr 10 10:38:12 devstack sudo[87140]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.653s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:12 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-aaa03cc6-40a6-43ec-8e5c-17b14669cc96 tempest-GroupsTest-788584442 None] Delete group completed successfully. Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-6d183b27-fd9c-4054-a2e9-91ff5d18b425-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-6d183b27-fd9c-4054-a2e9-91ff5d18b425-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-quobyte-6d183b27-fd9c-4054-a2e9-91ff5d18b425" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-6d183b27-fd9c-4054-a2e9-91ff5d18b425" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[021d1fca-da80-49eb-afbc-089a7db8756f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:12 devstack sudo[87148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425 Apr 10 10:38:12 devstack sudo[87148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:12 devstack sudo[87144]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 1073741824" returned: 0 in 0.895s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:12 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 Apr 10 10:38:12 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:13 devstack sudo[87148]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425" returned: 0 in 0.874s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:13 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425 Apr 10 10:38:13 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:13 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0" returned: 0 in 0.659s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] <== create_volume: return (1616ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce24d483-a734-49db-bb9c-6b2095782462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b55e0eb-fb41-4484-b197-94d9025dad31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:13 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Volume volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 (c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0): created successfully Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b55e0eb-fb41-4484-b197-94d9025dad31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Flow 'volume_create_manager' (f6231857-7cd0-4342-805a-b376a2878efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:13 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0d89d0ca-3525-453a-aa94-f4f014f18216 tempest-VolumesListTestJSON-83175647 None] Created volume successfully. Apr 10 10:38:13 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6d183b27-fd9c-4054-a2e9-91ff5d18b425" returned: 0 in 0.501s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-6d183b27-fd9c-4054-a2e9-91ff5d18b425" released by "delete_volume" :: held 1.428s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:13 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created reservations ['b6a62def-2545-439b-837d-5419695738df', '305adf93-5fba-401d-a1cc-ce229d5d968b', '63ada79f-dd9e-4cbf-ad95-7f47f7271992', 'dd12c8d1-2350-4b6a-b46d-ca15e3e2d907'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:14 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:14 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-605de705-24ec-4830-8fee-a7b3388e2b5b-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:14 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.684s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-605de705-24ec-4830-8fee-a7b3388e2b5b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:14 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Deleted volume successfully. Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3ad5320-1833-481f-a7ad-ffe9928d1d56 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-6d183b27-fd9c-4054-a2e9-91ff5d18b425-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-quobyte-605de705-24ec-4830-8fee-a7b3388e2b5b" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-605de705-24ec-4830-8fee-a7b3388e2b5b" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddc575c-a074-42b5-9e5c-9fcd399dd138]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:14 devstack sudo[87166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b Apr 10 10:38:14 devstack sudo[87166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:15 devstack sudo[87166]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b" returned: 0 in 0.668s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:15 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b Apr 10 10:38:15 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:16 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-605de705-24ec-4830-8fee-a7b3388e2b5b" returned: 0 in 0.634s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-605de705-24ec-4830-8fee-a7b3388e2b5b" released by "delete_volume" :: held 1.337s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created reservations ['66641fa3-ab81-4692-af4f-a8066fcac4af', '66b469a1-2d22-45dc-bc73-505b218e8536', '12fb75d9-658a-442d-981d-9aefd724d96a', 'b1bc6330-d52d-4ae8-b1bf-2cab731b00c7'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:16 devstack sudo[87175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:16 devstack sudo[87175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Acquiring lock "cinder-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Lock "cinder-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:16 devstack sudo[87175]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Acquiring lock "cinder-quobyte-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.644s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:16 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Deleted volume successfully. Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Lock "cinder-quobyte-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0" acquired by "delete_volume" :: waited 0.031s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69dcc66-9756-4766-a78f-c46442bde25f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e2e1ad65-8d72-4304-ae34-da52d0abbfc0 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-605de705-24ec-4830-8fee-a7b3388e2b5b-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-7aa6f470-f880-43bf-8c62-e7e338d0a9f6-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-7aa6f470-f880-43bf-8c62-e7e338d0a9f6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-quobyte-7aa6f470-f880-43bf-8c62-e7e338d0a9f6" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-7aa6f470-f880-43bf-8c62-e7e338d0a9f6" acquired by "delete_volume" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e6975d-a0a5-4e87-b3fb-5e2db189d0ac]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:17 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 Apr 10 10:38:17 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:17 devstack sudo[87179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6 Apr 10 10:38:17 devstack sudo[87179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:17 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0" returned: 0 in 0.730s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:17 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0 Apr 10 10:38:17 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:17 devstack sudo[87179]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6" returned: 0 in 0.649s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:17 devstack sudo[87190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6 Apr 10 10:38:17 devstack sudo[87190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Flow 'volume_create_manager' (20344b0b-7991-45ed-ba07-fe4d1ff11d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2143efcc-f957-4974-ac7e-cd37c40bed6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2143efcc-f957-4974-ac7e-cd37c40bed6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-536167874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833b175f-85f9-4c02-9dff-757b707685af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f73d4bd246f412d83af2273b28de56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:18Z,use_quota=True,user_id='d0add307f9b644c4a288aed3be6993b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009f0cb9-e302-4917-8b89-c9a799c401b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (009f0cb9-e302-4917-8b89-c9a799c401b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce489c0-72b2-46de-9f59-79d7990c4255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ce489c0-72b2-46de-9f59-79d7990c4255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '833b175f-85f9-4c02-9dff-757b707685af', 'volume_name': 'volume-833b175f-85f9-4c02-9dff-757b707685af', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fc2e37-a381-42df-8184-8e596f7ad085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16fc2e37-a381-42df-8184-8e596f7ad085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ebd39b-1084-46c0-953a-23af11154458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:18 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Volume 833b175f-85f9-4c02-9dff-757b707685af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-833b175f-85f9-4c02-9dff-757b707685af', 'volume_size': 1} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-536167874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=833b175f-85f9-4c02-9dff-757b707685af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f73d4bd246f412d83af2273b28de56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:18Z,use_quota=True,user_id='d0add307f9b644c4a288aed3be6993b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Creating volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:18 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:18 devstack sudo[87190]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7aa6f470-f880-43bf-8c62-e7e338d0a9f6" returned: 0 in 0.533s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:18 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af 1073741824 Apr 10 10:38:18 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-7aa6f470-f880-43bf-8c62-e7e338d0a9f6" released by "delete_volume" :: held 1.214s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created reservations ['82001a17-79d4-47f4-a4cd-f391a4a8c187', '43305186-db48-4cb7-b215-a2433b96f045', '33d72935-c3b8-4b86-8be2-8becb194803b', '2fd0dc5b-971e-4341-84da-3777f3782660'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:18 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0" returned: 0 in 0.707s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Lock "cinder-quobyte-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0" released by "delete_volume" :: held 1.489s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:18 devstack sudo[87196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:18 devstack sudo[87196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Created reservations ['821d631a-efb0-4301-a838-760557e97ac1', '0f1d9808-79c2-43c9-be52-6b6e112c7918', 'd1ecc17a-90e2-4ece-aef6-df237ec24425', 'e3298415-db81-4ffb-918e-b054ed9cba58'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:18 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:18 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:18 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af 1073741824" returned: 0 in 0.711s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:19 devstack sudo[87196]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:19 devstack sudo[87204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af Apr 10 10:38:19 devstack sudo[87204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.640s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:19 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Deleted volume successfully. Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-24d97e10-2cce-4eb2-aca4-399f8a966a1f tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-7aa6f470-f880-43bf-8c62-e7e338d0a9f6-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:19 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.607s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:19 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Deleted volume successfully. Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1339ab0e-514c-4ba2-bfe2-d766de9bff99 tempest-VolumesListTestJSON-83175647 None] Lock "cinder-c5a7f2e5-dd2d-4b38-ab03-ff8db2c85cd0-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Acquiring lock "cinder-63769884-a6fd-425c-a95c-5fe3002397c8-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Lock "cinder-63769884-a6fd-425c-a95c-5fe3002397c8-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Acquiring lock "cinder-quobyte-63769884-a6fd-425c-a95c-5fe3002397c8" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-e25a8599-67de-4ad2-b7b6-c6474beaba05-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-e25a8599-67de-4ad2-b7b6-c6474beaba05-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Lock "cinder-quobyte-63769884-a6fd-425c-a95c-5fe3002397c8" acquired by "delete_volume" :: waited 0.044s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f4e1db-4ba6-436c-a893-07e9427f93d1]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-quobyte-e25a8599-67de-4ad2-b7b6-c6474beaba05" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-e25a8599-67de-4ad2-b7b6-c6474beaba05" acquired by "delete_volume" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa616ced-2b0a-4ecd-b450-d2799e95c4b0]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:19 devstack sudo[87207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8 Apr 10 10:38:19 devstack sudo[87207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:19 devstack sudo[87208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05 Apr 10 10:38:19 devstack sudo[87208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:19 devstack sudo[87204]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af" returned: 0 in 0.634s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.395s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65ebd39b-1084-46c0-953a-23af11154458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-833b175f-85f9-4c02-9dff-757b707685af', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3206cf-6367-4d1a-8e58-9d1d258a4094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:19 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Volume volume-833b175f-85f9-4c02-9dff-757b707685af (833b175f-85f9-4c02-9dff-757b707685af): created successfully Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c3206cf-6367-4d1a-8e58-9d1d258a4094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Flow 'volume_create_manager' (20344b0b-7991-45ed-ba07-fe4d1ff11d0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:19 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-33cfe5c2-4b08-49fb-8a7b-f4a7c798d7c5 tempest-SnapshotsActionsTest-1428698067 None] Created volume successfully. Apr 10 10:38:20 devstack sudo[87207]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8" returned: 0 in 0.654s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:20 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8 Apr 10 10:38:20 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:20 devstack sudo[87208]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05" returned: 0 in 0.619s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:20 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05 Apr 10 10:38:20 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Creating offline snapshot e098d355-0095-4633-b9ee-5d474422acd7 of volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[462d9402-1c67-4b20-9005-fa62fc4967e2]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:20 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-63769884-a6fd-425c-a95c-5fe3002397c8" returned: 0 in 0.578s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:20 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e25a8599-67de-4ad2-b7b6-c6474beaba05" returned: 0 in 0.549s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Lock "cinder-quobyte-63769884-a6fd-425c-a95c-5fe3002397c8" released by "delete_volume" :: held 1.281s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:20 devstack sudo[87224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af Apr 10 10:38:20 devstack sudo[87224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-e25a8599-67de-4ad2-b7b6-c6474beaba05" released by "delete_volume" :: held 1.204s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Created reservations ['6d9daec7-3205-45b0-8637-08e54b87c1fc', '041182bf-f47e-49cc-aaa1-1f5b87576eed', '39e4cf41-6bcb-4e5b-bf44-c9f5799a821c', 'f0257fa4-2b44-4bf5-8410-fc5f16d3dc9d'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created reservations ['5035cd2f-724d-4ad4-9c23-de5199e5f9f0', '452a299b-75c1-4310-9842-80c14b28642c', 'e920f6f8-37c0-48f7-af6a-f42ace200111', '9bb95b98-3363-4440-b946-c41b8dd66b7b'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:20 devstack sudo[87226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:20 devstack sudo[87226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:20 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:20 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:21 devstack sudo[87224]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af" returned: 0 in 0.687s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:21 devstack sudo[87234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 1G Apr 10 10:38:21 devstack sudo[87234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:21 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.525s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:21 devstack sudo[87226]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:21 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Deleted volume successfully. Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.567s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:21 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Deleted volume successfully. Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a89a49d0-12af-4d46-a5bf-e60e2c213d97 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-e25a8599-67de-4ad2-b7b6-c6474beaba05-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-76e03518-3a15-4d62-b442-d7ae841ac00f tempest-VolumesListTestJSON-83175647 None] Lock "cinder-63769884-a6fd-425c-a95c-5fe3002397c8-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-bf202fd0-8abf-44fe-b3bd-731eb35c4772-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Acquiring lock "cinder-20c8eeee-6ed9-4371-a3ab-97986c39d5be-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-bf202fd0-8abf-44fe-b3bd-731eb35c4772-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Lock "cinder-20c8eeee-6ed9-4371-a3ab-97986c39d5be-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-quobyte-bf202fd0-8abf-44fe-b3bd-731eb35c4772" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-bf202fd0-8abf-44fe-b3bd-731eb35c4772" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10a8e96-5864-40b1-9cf2-6aa3202f6673]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Acquiring lock "cinder-quobyte-20c8eeee-6ed9-4371-a3ab-97986c39d5be" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Lock "cinder-quobyte-20c8eeee-6ed9-4371-a3ab-97986c39d5be" acquired by "delete_volume" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a9692c-8e6c-4aa8-b424-a1a45fa35ecd]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:21 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772 Apr 10 10:38:21 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:21 devstack sudo[87241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be Apr 10 10:38:21 devstack sudo[87241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:21 devstack sudo[87234]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 1G" returned: 0 in 0.667s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:21 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:21 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:22 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772" returned: 0 in 0.597s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:22 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772 Apr 10 10:38:22 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:22 devstack sudo[87241]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be" returned: 0 in 0.683s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:22 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.523s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:22 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 is being set with open permissions: ugo+rw Apr 10 10:38:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:22 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be Apr 10 10:38:22 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:22 devstack sudo[87259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:22 devstack sudo[87259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:22 devstack sudo[87259]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.493s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:22 devstack sudo[87265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.info Apr 10 10:38:22 devstack sudo[87265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:23 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bf202fd0-8abf-44fe-b3bd-731eb35c4772" returned: 0 in 0.703s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-bf202fd0-8abf-44fe-b3bd-731eb35c4772" released by "delete_volume" :: held 1.334s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:23 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-20c8eeee-6ed9-4371-a3ab-97986c39d5be" returned: 0 in 0.622s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Lock "cinder-quobyte-20c8eeee-6ed9-4371-a3ab-97986c39d5be" released by "delete_volume" :: held 1.335s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created reservations ['13e6cfc7-9418-4db1-9adb-058c727f7494', 'c555c13f-b767-4dfd-844b-3080cf5604d7', '1871e13f-769d-40c0-bb49-725f13d1954e', '10dc8671-5345-40a5-a66d-e454d985fc39'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Created reservations ['ba785fa8-8128-4cdb-87f1-97e884aa7fa1', 'e147d343-7249-4ddc-85a3-be68e69227af', '9c664a8c-4df7-4152-a706-8de8c07d996e', '6f3c94ac-e6d7-408a-baa9-fb243b68b5cc'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:23 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:23 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:23 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:23 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:23 devstack sudo[87265]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.info" returned: 0 in 0.605s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.info is being set with open permissions: ugo+rw Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:23 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.info Apr 10 10:38:23 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:23 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.556s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:23 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Deleted volume successfully. Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-fe25e6d1-77e8-4e5c-88bf-0865ed49d0df tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-bf202fd0-8abf-44fe-b3bd-731eb35c4772-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:23 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.552s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:23 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Deleted volume successfully. Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-737d95c8-1411-4ea1-97b1-d0ba9d956a5c tempest-VolumesListTestJSON-83175647 None] Lock "cinder-20c8eeee-6ed9-4371-a3ab-97986c39d5be-delete_volume" released by "delete_volume" :: held 2.161s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-360a8d53-dc35-4e77-b34b-1ecb16389d25-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-360a8d53-dc35-4e77-b34b-1ecb16389d25-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "cinder-quobyte-360a8d53-dc35-4e77-b34b-1ecb16389d25" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-360a8d53-dc35-4e77-b34b-1ecb16389d25" acquired by "delete_volume" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:24 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29471d3-a381-4852-8cea-d966f28ef318]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:24 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25 Apr 10 10:38:24 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:24 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.info" returned: 0 in 0.569s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.624s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:24 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ee478d29-de00-4134-ab63-7a1bb1a5a654 tempest-SnapshotsActionsTest-1428698067 None] Create snapshot completed successfully Apr 10 10:38:24 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25" returned: 0 in 0.622s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:24 devstack sudo[87282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25 Apr 10 10:38:24 devstack sudo[87282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:25 devstack sudo[87282]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-360a8d53-dc35-4e77-b34b-1ecb16389d25" returned: 0 in 0.871s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-quobyte-360a8d53-dc35-4e77-b34b-1ecb16389d25" released by "delete_volume" :: held 1.536s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Created reservations ['ec449ee4-5c40-4215-be6e-dba24ed51d5d', 'cd6e3b3e-7e38-49d1-8b31-ebf3ddd27e99', 'd8f2f3ef-b83e-40c2-89f5-173a97520ab9', '7393abbe-7959-46be-922e-4488136905f9'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] Creating offline snapshot 08b846de-809e-4d45-934e-515f02db0f9b of volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[26aed44a-8f69-40be-b94c-9549721c21e1]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:25 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:25 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:25 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:25 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:26 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.890s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:26 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:26 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Deleted volume successfully. Apr 10 10:38:26 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4e1dd0ad-4d0d-472e-9068-cc0bec312407 tempest-CreateVolumesFromSourceVolumeTest-1265702046 None] Lock "cinder-360a8d53-dc35-4e77-b34b-1ecb16389d25-delete_volume" released by "delete_volume" :: held 2.819s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:26 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 1.081s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:26 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b 1G Apr 10 10:38:26 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Flow 'volume_create_manager' (36e8447e-7ed3-4c3a-b143-ba7aaa54d96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126192e4-0e61-47d4-afdd-686f0158e2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (126192e4-0e61-47d4-afdd-686f0158e2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1701050467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66d564c-8747-4efd-b8a4-93ef220e0cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ef0649ba604a4e8fabfbd2e8fbf8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:27Z,use_quota=True,user_id='b001e3e5eeca42e683f904f82c9e4d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad1c8c9-ddee-4bd4-a2ca-c0bb2c43fa82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aad1c8c9-ddee-4bd4-a2ca-c0bb2c43fa82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae4ddca-d935-43c3-a9ec-fc8fabb1c8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae4ddca-d935-43c3-a9ec-fc8fabb1c8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd66d564c-8747-4efd-b8a4-93ef220e0cbb', 'volume_name': 'volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:27 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e2b65d-6bb6-417a-841d-3263fbac7910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e2b65d-6bb6-417a-841d-3263fbac7910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a5e5b5-aa7a-4325-a740-534506afdd01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:27 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Volume d66d564c-8747-4efd-b8a4-93ef220e0cbb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb', 'volume_size': 1} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b 1G" returned: 0 in 0.736s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:27 devstack sudo[87298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b Apr 10 10:38:27 devstack sudo[87298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:28 devstack sudo[87298]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b" returned: 0 in 0.590s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:28 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b is being set with open permissions: ugo+rw Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:28 devstack sudo[87303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b Apr 10 10:38:28 devstack sudo[87303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:28 devstack sudo[87303]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b" returned: 0 in 0.483s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.994s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.100s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1701050467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d66d564c-8747-4efd-b8a4-93ef220e0cbb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05ef0649ba604a4e8fabfbd2e8fbf8c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:27Z,use_quota=True,user_id='b001e3e5eeca42e683f904f82c9e4d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Creating volume d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:28 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:28 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb 1073741824 Apr 10 10:38:28 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:28 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-7f946b16-f19a-40f8-a60b-bfbbda646db5 tempest-SnapshotsActionsTest-1428698067 None] Create snapshot completed successfully Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-08b846de-809e-4d45-934e-515f02db0f9b-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-08b846de-809e-4d45-934e-515f02db0f9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-quobyte-08b846de-809e-4d45-934e-515f02db0f9b" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-08b846de-809e-4d45-934e-515f02db0f9b" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Deleting offline snapshot 08b846de-809e-4d45-934e-515f02db0f9b of volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] snapshot_file for this snap is: volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a39eb93-3dd1-4de4-a908-96bce41e79df]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:29 devstack sudo[87308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b Apr 10 10:38:29 devstack sudo[87308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:29 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb 1073741824" returned: 0 in 0.635s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:29 devstack sudo[87313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb Apr 10 10:38:29 devstack sudo[87313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:29 devstack sudo[87308]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b" returned: 0 in 0.709s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc3e2d4-e9a9-4694-bdc8-332875bf0615]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:29 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:29 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:29 devstack sudo[87313]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb" returned: 0 in 0.567s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3a5e5b5-aa7a-4325-a740-534506afdd01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c01ba17-1383-4e65-9751-e4684640db22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:29 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Volume volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb (d66d564c-8747-4efd-b8a4-93ef220e0cbb): created successfully Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c01ba17-1383-4e65-9751-e4684640db22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Flow 'volume_create_manager' (36e8447e-7ed3-4c3a-b143-ba7aaa54d96a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:29 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-2b8232fd-f888-461c-9a6c-fa2006d34293 tempest-VolumesSnapshotListTestJSON-876442528 None] Created volume successfully. Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Flow 'volume_create_manager' (adcde3e8-7f77-4dff-8cfd-9ac5cacdb1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e398aa03-e30a-45b1-9b88-578dbb2c6007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e398aa03-e30a-45b1-9b88-578dbb2c6007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-27353690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e8bfb43611476fa6a374a3b1bfc308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:30Z,use_quota=True,user_id='1644b022bc5a422891d626cf8e179ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af5d33b-60c5-4d5f-a367-9355bf12dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0af5d33b-60c5-4d5f-a367-9355bf12dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887dde58-ba93-47ea-a8b0-be8bbd85d57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (887dde58-ba93-47ea-a8b0-be8bbd85d57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee', 'volume_name': 'volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232271bd-265d-4c50-8d34-a00aec83cbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (232271bd-265d-4c50-8d34-a00aec83cbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a84083-05ac-4293-93fd-2ad272d8f841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:30 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Volume 80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee', 'volume_size': 1} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-27353690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e8bfb43611476fa6a374a3b1bfc308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:30Z,use_quota=True,user_id='1644b022bc5a422891d626cf8e179ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Creating volume 80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:30 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:30 devstack sudo[87325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee 1073741824 Apr 10 10:38:30 devstack sudo[87325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:30 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.512s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:30 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b Apr 10 10:38:30 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:30 devstack sudo[87325]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee 1073741824" returned: 0 in 0.628s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:30 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b" returned: 0 in 0.621s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:30 devstack sudo[87335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee Apr 10 10:38:30 devstack sudo[87335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:30 devstack sudo[87336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b Apr 10 10:38:30 devstack sudo[87336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:31 devstack sudo[87335]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee" returned: 0 in 0.470s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:31 devstack sudo[87336]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.416s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Creating offline snapshot f48bc9a5-1d27-4de2-aff5-cd59abdf8736 of volume d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.08b846de-809e-4d45-934e-515f02db0f9b" returned: 0 in 0.481s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48163a7-c518-4759-9c78-5de3e69b57f7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6a84083-05ac-4293-93fd-2ad272d8f841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f2e159-1776-4ca7-ba9f-fd8fe14bcca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-08b846de-809e-4d45-934e-515f02db0f9b" released by "_delete_snapshot" :: held 2.422s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:31 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Volume volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee (80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee): created successfully Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f2e159-1776-4ca7-ba9f-fd8fe14bcca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Flow 'volume_create_manager' (adcde3e8-7f77-4dff-8cfd-9ac5cacdb1a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" released by "delete_snapshot" :: held 2.454s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:31 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-61cab416-6dd7-4ccf-a7a6-cf8bcbdaedc3 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Created volume successfully. Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Created reservations ['f0f06ffe-21e3-4e27-a97d-3d4b37817d2b', 'c903120f-fab6-45aa-9c97-496d60498203', 'bb70073e-7187-49d4-9562-5865469033a7', '8fd9b264-eead-47a2-a96b-4a6c6c8eccd5'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:31 devstack sudo[87341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb Apr 10 10:38:31 devstack sudo[87341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:31 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Delete snapshot completed successfully. Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e930b917-cc6d-4aaa-b3a8-074605c65ec3 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-08b846de-809e-4d45-934e-515f02db0f9b-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:31 devstack sudo[87341]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb" returned: 0 in 0.525s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:31 devstack sudo[87347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 1G Apr 10 10:38:31 devstack sudo[87347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Acquiring lock "cinder-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "cinder-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Acquiring lock "cinder-quobyte-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "cinder-quobyte-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee" acquired by "delete_volume" :: waited 0.020s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c592ebf-94b7-4e9c-bd26-66c524558963]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:32 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee Apr 10 10:38:32 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:32 devstack sudo[87347]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 1G" returned: 0 in 0.647s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:32 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 Apr 10 10:38:32 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:32 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee" returned: 0 in 0.556s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:33 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee Apr 10 10:38:33 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:33 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736" returned: 0 in 0.507s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:33 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 is being set with open permissions: ugo+rw Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:33 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 Apr 10 10:38:33 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:33 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736" returned: 0 in 0.449s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:33 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee" returned: 0 in 0.497s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "cinder-quobyte-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee" released by "delete_volume" :: held 1.082s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Created reservations ['4622ef21-0b46-4b5b-84fa-b86a9f174ba9', 'd1b8a0d8-f12b-4be8-90fe-b7248f35e71d', '45b2cf2d-caf5-4e3f-b58b-adec393cf20c', '41329286-9f78-4efe-a924-7449f587da76'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:33 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.info Apr 10 10:38:33 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:33 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:33 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:33 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.info" returned: 0 in 0.455s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:33 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.info is being set with open permissions: ugo+rw Apr 10 10:38:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:34 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.info Apr 10 10:38:34 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:34 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.495s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:34 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Deleted volume successfully. Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7519d110-10f8-4980-893a-ddc11ca0de06 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "cinder-80d9fbf9-33ae-4bf6-8c55-c7f09aac57ee-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:34 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.info" returned: 0 in 0.479s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.184s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.039s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] Creating offline snapshot 06c88b43-0b52-4dab-b30a-f7a6bfc49792 of volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:34 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a13dfc6b-4a1e-4d7d-9297-e2b3f5fb0324 tempest-VolumesSnapshotListTestJSON-876442528 None] Create snapshot completed successfully Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[978f073e-7784-4f67-9af4-92aa72e72c96]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:34 devstack sudo[87377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:34 devstack sudo[87377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Flow 'volume_create_manager' (581fb505-7250-436f-bff7-ff2dbbe6c16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4e4ad9-a4e6-4c22-9b2f-e6a1b18a8570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4e4ad9-a4e6-4c22-9b2f-e6a1b18a8570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-90450521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ab3c8f-6efc-454f-a2f9-440ffa793f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e8bfb43611476fa6a374a3b1bfc308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:35Z,use_quota=True,user_id='1644b022bc5a422891d626cf8e179ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba64f5f0-942e-4391-add0-aa7aa1dec1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba64f5f0-942e-4391-add0-aa7aa1dec1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0995d99-01b5-450d-b768-707fbf4cc8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0995d99-01b5-450d-b768-707fbf4cc8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06ab3c8f-6efc-454f-a2f9-440ffa793f4e', 'volume_name': 'volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2315b996-499b-47b9-b06f-55c464dbe364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2315b996-499b-47b9-b06f-55c464dbe364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76293c1-bdc9-458f-a408-c77ce97dd173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:34 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Volume 06ab3c8f-6efc-454f-a2f9-440ffa793f4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e', 'volume_size': 1} Apr 10 10:38:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:35 devstack sudo[87377]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.590s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:35 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 1G Apr 10 10:38:35 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:35 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 1G" returned: 0 in 0.597s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:35 devstack sudo[87387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 Apr 10 10:38:35 devstack sudo[87387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:36 devstack sudo[87387]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792" returned: 0 in 0.514s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:36 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 is being set with open permissions: ugo+rw Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:36 devstack sudo[87392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 Apr 10 10:38:36 devstack sudo[87392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:36 devstack sudo[87392]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792" returned: 0 in 0.472s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=211,cinder:UPDATE=285,cinder:INSERT=63,cinder:DELETE=21 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:UPDATE=292,cinder:DELETE=23,cinder:SELECT=220,cinder:INSERT=68 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.853s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-90450521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06ab3c8f-6efc-454f-a2f9-440ffa793f4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8e8bfb43611476fa6a374a3b1bfc308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:35Z,use_quota=True,user_id='1644b022bc5a422891d626cf8e179ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Creating volume 06ab3c8f-6efc-454f-a2f9-440ffa793f4e {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:36 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:36 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e 1073741824 Apr 10 10:38:36 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:36 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-534fd5fc-3964-46c4-a149-e726b521c13b tempest-SnapshotsActionsTest-1428698067 None] Create snapshot completed successfully Apr 10 10:38:37 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e 1073741824" returned: 0 in 0.606s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:37 devstack sudo[87400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e Apr 10 10:38:37 devstack sudo[87400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-06c88b43-0b52-4dab-b30a-f7a6bfc49792-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-06c88b43-0b52-4dab-b30a-f7a6bfc49792-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-quobyte-06c88b43-0b52-4dab-b30a-f7a6bfc49792" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-06c88b43-0b52-4dab-b30a-f7a6bfc49792" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Deleting offline snapshot 06c88b43-0b52-4dab-b30a-f7a6bfc49792 of volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] snapshot_file for this snap is: volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[af71209b-2b09-4b1c-8d76-f78a3f76a3aa]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:37 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 Apr 10 10:38:37 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:37 devstack sudo[87400]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e" returned: 0 in 0.552s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.763s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] Creating offline snapshot 2349b2e0-a415-4790-8824-c9d165377b93 of volume d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76293c1-bdc9-458f-a408-c77ce97dd173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1e5109-8426-4326-aef7-bdbb01ae18ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b211f74-7889-4509-a6e4-b281ba0b93fd]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:38 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Volume volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e (06ab3c8f-6efc-454f-a2f9-440ffa793f4e): created successfully Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1e5109-8426-4326-aef7-bdbb01ae18ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Flow 'volume_create_manager' (581fb505-7250-436f-bff7-ff2dbbe6c16c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:38 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-419d8250-e51b-485e-9136-0b89fd024b04 tempest-VolumeQuotasAdminTestJSON-1572229991 None] Created volume successfully. Apr 10 10:38:38 devstack sudo[87405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 Apr 10 10:38:38 devstack sudo[87405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:38 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792" returned: 0 in 0.602s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[168e4c79-a712-4466-b0e9-ab40068805b0]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:38 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:38 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:38 devstack sudo[87405]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736" returned: 0 in 0.562s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:38 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 1G Apr 10 10:38:38 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:39 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.624s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:39 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 Apr 10 10:38:39 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:39 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:39 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:39 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 1G" returned: 0 in 0.688s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:39 devstack sudo[87427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 Apr 10 10:38:39 devstack sudo[87427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:39 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792" returned: 0 in 0.620s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:39 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792 Apr 10 10:38:39 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:39 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.622s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:39 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-51fbef56-2154-40ac-b9a6-5488ca41161c tempest-VolumeQuotasAdminTestJSON-1867993012 None] Transfer volume completed successfully. Apr 10 10:38:39 devstack sudo[87427]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93" returned: 0 in 0.683s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:39 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 is being set with open permissions: ugo+rw Apr 10 10:38:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:39 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 Apr 10 10:38:39 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:40 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.06c88b43-0b52-4dab-b30a-f7a6bfc49792" returned: 0 in 0.517s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-06c88b43-0b52-4dab-b30a-f7a6bfc49792" released by "_delete_snapshot" :: held 2.436s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" released by "delete_snapshot" :: held 2.464s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Created reservations ['d06ac490-e650-4e6b-b556-bb18f124c647', '06fd58f4-70c6-4c69-a494-f101b05d1a12', '403f8d45-bbd2-4388-b1d8-3f90807fb4ea', 'eb8f0815-222f-44d7-bb3d-b6a6e8ffa9da'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:40 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Delete snapshot completed successfully. Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39058eb6-e36d-44e9-82fe-7dcfead18ecb tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-06c88b43-0b52-4dab-b30a-f7a6bfc49792-delete_snapshot" released by "delete_snapshot" :: held 2.604s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:40 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93" returned: 0 in 0.517s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:40 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-50b6e5cd-8836-4fda-8283-39445e39a8da tempest-VolumesSnapshotListTestJSON-876442528 None] Create snapshot completed successfully Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Acquiring lock "cinder-06ab3c8f-6efc-454f-a2f9-440ffa793f4e-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Lock "cinder-06ab3c8f-6efc-454f-a2f9-440ffa793f4e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Acquiring lock "cinder-quobyte-06ab3c8f-6efc-454f-a2f9-440ffa793f4e" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Lock "cinder-quobyte-06ab3c8f-6efc-454f-a2f9-440ffa793f4e" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf00ed64-27fc-4275-bd47-6c7744e65c3a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:40 devstack sudo[87442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e Apr 10 10:38:40 devstack sudo[87442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] Creating offline snapshot 21565d26-f698-47a5-affd-0ea8c7a44c64 of volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde12473-039f-4f3d-b3a5-e7f16bec5ecb]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:41 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:41 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:41 devstack sudo[87442]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e" returned: 0 in 0.547s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:41 devstack sudo[87449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e Apr 10 10:38:41 devstack sudo[87449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:41 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.523s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:41 devstack sudo[87455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 1G Apr 10 10:38:41 devstack sudo[87455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:41 devstack sudo[87449]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-06ab3c8f-6efc-454f-a2f9-440ffa793f4e" returned: 0 in 0.511s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Lock "cinder-quobyte-06ab3c8f-6efc-454f-a2f9-440ffa793f4e" released by "delete_volume" :: held 1.083s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Created reservations ['76b262f8-0ac3-4d09-b75c-c39e77949272', '6940b9e0-a09c-47df-8e07-282028eec980', '75ca727d-d968-49ec-a170-66cdcbaa60a5', '1bf6f201-7ec7-4218-81c9-cfe077d57ff6'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:41 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:41 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:42 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.479s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:42 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:42 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Deleted volume successfully. Apr 10 10:38:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c484dc1f-9a2c-41e9-bd9d-96b7e196f025 tempest-VolumeQuotasAdminTestJSON-731236449 None] Lock "cinder-06ab3c8f-6efc-454f-a2f9-440ffa793f4e-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:42 devstack sudo[87455]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 1G" returned: 0 in 0.718s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:42 devstack sudo[87464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 Apr 10 10:38:42 devstack sudo[87464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:43 devstack sudo[87464]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64" returned: 0 in 0.682s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:43 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 is being set with open permissions: ugo+rw Apr 10 10:38:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:43 devstack sudo[87469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 Apr 10 10:38:43 devstack sudo[87469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:43 devstack sudo[87469]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64" returned: 0 in 0.695s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.700s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.300s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] Creating offline snapshot 6e0df8b6-520e-4582-8db3-4e980cd4ff3a of volume d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:43 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bc5607-28a0-408d-acb5-880799785ef5]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:43 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a6ac0cbd-606a-43fb-a9c5-05d8e8fa43a7 tempest-SnapshotsActionsTest-1428698067 None] Create snapshot completed successfully Apr 10 10:38:44 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 Apr 10 10:38:44 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-21565d26-f698-47a5-affd-0ea8c7a44c64-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-21565d26-f698-47a5-affd-0ea8c7a44c64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-quobyte-21565d26-f698-47a5-affd-0ea8c7a44c64" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-21565d26-f698-47a5-affd-0ea8c7a44c64" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Deleting offline snapshot 21565d26-f698-47a5-affd-0ea8c7a44c64 of volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] snapshot_file for this snap is: volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ce5a3b-8634-4202-9399-bac7200f762d]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:44 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93" returned: 0 in 0.617s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:44 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 Apr 10 10:38:44 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:44 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a 1G Apr 10 10:38:44 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:45 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64" returned: 0 in 0.586s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1731ba20-4f5c-484e-8ad9-bbbe2a8ee00c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:45 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:45 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:45 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a 1G" returned: 0 in 0.790s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:45 devstack sudo[87489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a Apr 10 10:38:45 devstack sudo[87489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:45 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.656s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:45 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 Apr 10 10:38:45 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:45 devstack sudo[87489]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a" returned: 0 in 0.602s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:45 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a is being set with open permissions: ugo+rw Apr 10 10:38:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:45 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a Apr 10 10:38:45 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:46 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64" returned: 0 in 0.559s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:46 devstack sudo[87505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64 Apr 10 10:38:46 devstack sudo[87505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:46 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a" returned: 0 in 0.547s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.659s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:46 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b3becdd3-d5e2-49fd-8bb6-74692caa737d tempest-VolumesSnapshotListTestJSON-876442528 None] Create snapshot completed successfully Apr 10 10:38:46 devstack sudo[87505]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.21565d26-f698-47a5-affd-0ea8c7a44c64" returned: 0 in 0.550s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-21565d26-f698-47a5-affd-0ea8c7a44c64" released by "_delete_snapshot" :: held 2.414s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" released by "delete_snapshot" :: held 2.438s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:46 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Created reservations ['d911b891-766f-462d-9446-d3c7919971f2', '6eafab6d-51ca-440e-8ba7-c1012bd63566', '4ee403dd-dc77-4954-9335-05f75c5aa214', '021ab99d-b258-4039-b7f4-df4c2040ad61'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Delete snapshot completed successfully. Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-8c8b6e6b-06ce-4f2e-ab9f-8e81cfb5c829 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-21565d26-f698-47a5-affd-0ea8c7a44c64-delete_snapshot" released by "delete_snapshot" :: held 2.704s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-6e0df8b6-520e-4582-8db3-4e980cd4ff3a-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-6e0df8b6-520e-4582-8db3-4e980cd4ff3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-quobyte-6e0df8b6-520e-4582-8db3-4e980cd4ff3a" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-6e0df8b6-520e-4582-8db3-4e980cd4ff3a" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Deleting offline snapshot 6e0df8b6-520e-4582-8db3-4e980cd4ff3a of volume d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] snapshot_file for this snap is: volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd388c3c-0868-4d8f-843d-1e4a54938e4a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:47 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a Apr 10 10:38:47 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] Creating offline snapshot 07cf835b-cf46-41d8-bdb8-fe1c071fe06a of volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a5bed3-492c-436c-9c0a-982cc68239c6]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:47 devstack sudo[87517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:47 devstack sudo[87517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:48 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a" returned: 0 in 0.579s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:48 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f07fda7-8ca0-43fa-a682-61d96284161c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:48 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 Apr 10 10:38:48 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:48 devstack sudo[87517]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.579s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:48 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a 1G Apr 10 10:38:48 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:48 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93" returned: 0 in 0.567s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:48 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a Apr 10 10:38:48 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:49 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a 1G" returned: 0 in 0.590s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:49 devstack sudo[87537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a Apr 10 10:38:49 devstack sudo[87537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Flow 'volume_create_manager' (82fbab70-0a1a-46bd-bfec-07dc6b490e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2757a8-b7a7-4ada-bb67-68d71a5c2ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af2757a8-b7a7-4ada-bb67-68d71a5c2ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1255762252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35da47f-409d-45a6-978b-ac8631abca28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e94e99f043b4fafabb69cfc1c310a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:49Z,use_quota=True,user_id='1bc42a3042454e639d85ff66908a87d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f1f9546-1301-4524-a4ce-37510dfc8271),volume_type_id=5f1f9546-1301-4524-a4ce-37510dfc8271)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db2bb10-e968-4e0e-a86a-f5f8661c6171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db2bb10-e968-4e0e-a86a-f5f8661c6171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1620556-78a6-47f3-b702-ed85ea4a4e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1620556-78a6-47f3-b702-ed85ea4a4e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a35da47f-409d-45a6-978b-ac8631abca28', 'volume_name': 'volume-a35da47f-409d-45a6-978b-ac8631abca28', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ca8fbf-b034-44cf-9414-8ef6696bb2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ca8fbf-b034-44cf-9414-8ef6696bb2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83c4623-873b-46d8-8890-7c1d7746a0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:49 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Volume a35da47f-409d-45a6-978b-ac8631abca28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a35da47f-409d-45a6-978b-ac8631abca28', 'volume_size': 1} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:49 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a" returned: 0 in 0.570s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:49 devstack sudo[87542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a Apr 10 10:38:49 devstack sudo[87542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:49 devstack sudo[87537]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a" returned: 0 in 0.489s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:49 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a is being set with open permissions: ugo+rw Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:49 devstack sudo[87547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a Apr 10 10:38:49 devstack sudo[87547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:49 devstack sudo[87542]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.6e0df8b6-520e-4582-8db3-4e980cd4ff3a" returned: 0 in 0.467s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-6e0df8b6-520e-4582-8db3-4e980cd4ff3a" released by "_delete_snapshot" :: held 2.234s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" released by "delete_snapshot" :: held 2.250s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Created reservations ['2f9a4291-07ad-46b0-9f06-6e7e8092501d', '84f99221-0ffd-44f0-9ae6-af7050ceec49', 'a0026dd9-5724-42c2-924c-584a42978b78', 'a664eae2-aeeb-4886-8379-f574b0fe287e'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:49 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Delete snapshot completed successfully. Apr 10 10:38:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d38a1c32-c836-40de-8dcc-b64367dd9de4 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-6e0df8b6-520e-4582-8db3-4e980cd4ff3a-delete_snapshot" released by "delete_snapshot" :: held 2.394s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:50 devstack sudo[87547]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a" returned: 0 in 0.434s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.172s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.716s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:38:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1255762252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35da47f-409d-45a6-978b-ac8631abca28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e94e99f043b4fafabb69cfc1c310a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:38:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:38:49Z,use_quota=True,user_id='1bc42a3042454e639d85ff66908a87d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f1f9546-1301-4524-a4ce-37510dfc8271),volume_type_id=5f1f9546-1301-4524-a4ce-37510dfc8271)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Creating volume a35da47f-409d-45a6-978b-ac8631abca28 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:38:50 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:50 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28 1073741824 Apr 10 10:38:50 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:50 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d11c5139-36a6-4fec-a982-33b702a7d038 tempest-SnapshotsActionsTest-1428698067 None] Create snapshot completed successfully Apr 10 10:38:50 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28 1073741824" returned: 0 in 0.529s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:50 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28 Apr 10 10:38:50 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-2349b2e0-a415-4790-8824-c9d165377b93-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-2349b2e0-a415-4790-8824-c9d165377b93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-quobyte-2349b2e0-a415-4790-8824-c9d165377b93" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-2349b2e0-a415-4790-8824-c9d165377b93" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Deleting offline snapshot 2349b2e0-a415-4790-8824-c9d165377b93 of volume d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] snapshot_file for this snap is: volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ddb7c3-e6e8-4907-b726-38b3c417aa61]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:50 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 Apr 10 10:38:50 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:51 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28" returned: 0 in 0.504s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f83c4623-873b-46d8-8890-7c1d7746a0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35da47f-409d-45a6-978b-ac8631abca28', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b151b3bb-4346-4c6e-a90e-459db6920670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-07cf835b-cf46-41d8-bdb8-fe1c071fe06a-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-07cf835b-cf46-41d8-bdb8-fe1c071fe06a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Acquiring lock "cinder-quobyte-07cf835b-cf46-41d8-bdb8-fe1c071fe06a" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-07cf835b-cf46-41d8-bdb8-fe1c071fe06a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Deleting offline snapshot 07cf835b-cf46-41d8-bdb8-fe1c071fe06a of volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] snapshot_file for this snap is: volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2799129e-1ed5-4e9b-bea2-2ba6b38175f6]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:51 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Volume volume-a35da47f-409d-45a6-978b-ac8631abca28 (a35da47f-409d-45a6-978b-ac8631abca28): created successfully Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b151b3bb-4346-4c6e-a90e-459db6920670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Flow 'volume_create_manager' (82fbab70-0a1a-46bd-bfec-07dc6b490e10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:38:51 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a Apr 10 10:38:51 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:51 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93" returned: 0 in 0.619s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4e2a32-f859-455f-819d-d47f41a5335a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:51 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f11ffb31-64ff-4dec-a438-7cc2a1bfbfa7 tempest-VolumeTypesAccessTest-624572328 None] Created volume successfully. Apr 10 10:38:51 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 Apr 10 10:38:51 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Acquiring lock "cinder-a35da47f-409d-45a6-978b-ac8631abca28-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Lock "cinder-a35da47f-409d-45a6-978b-ac8631abca28-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Acquiring lock "cinder-quobyte-a35da47f-409d-45a6-978b-ac8631abca28" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Lock "cinder-quobyte-a35da47f-409d-45a6-978b-ac8631abca28" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fdd444-35ab-4c23-99af-7c76b99dda4b]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:51 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28 Apr 10 10:38:51 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:51 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a" returned: 0 in 0.553s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[82552009-1ee0-4fff-9e84-680317624fa6]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:51 devstack sudo[87573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:51 devstack sudo[87573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:51 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736" returned: 0 in 0.599s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:52 devstack sudo[87580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 Apr 10 10:38:52 devstack sudo[87580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:52 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28" returned: 0 in 0.552s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:52 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28 Apr 10 10:38:52 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:52 devstack sudo[87573]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.592s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:52 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a Apr 10 10:38:52 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:52 devstack sudo[87580]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93" returned: 0 in 0.605s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:52 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93 Apr 10 10:38:52 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:52 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a35da47f-409d-45a6-978b-ac8631abca28" returned: 0 in 0.550s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Lock "cinder-quobyte-a35da47f-409d-45a6-978b-ac8631abca28" released by "delete_volume" :: held 1.126s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:52 devstack cinder-volume[82038]: WARNING cinder.quota [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-920410363 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-920410363, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:38:52 devstack cinder-volume[82038]: WARNING cinder.quota [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-920410363 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-920410363, it is now deprecated. Please use the default quota class for default quota. Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Created reservations ['9700cdfb-bca4-4132-9a13-ea22042125b7', '90cd0725-2c9c-4b7d-bc08-b295f7b35f30', '2b16de49-5727-40cc-b893-0fcb11b47b43', '531ad498-67bb-4abe-8cf6-4db67db99e70'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:52 devstack sudo[87597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:52 devstack sudo[87597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:53 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a" returned: 0 in 0.584s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:53 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a Apr 10 10:38:53 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:53 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.2349b2e0-a415-4790-8824-c9d165377b93" returned: 0 in 0.498s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-2349b2e0-a415-4790-8824-c9d165377b93" released by "_delete_snapshot" :: held 2.376s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" released by "delete_snapshot" :: held 2.402s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Created reservations ['b045a653-0e02-4372-ba5e-4f6cbf7c2021', 'fb8c4c9e-42cd-4d55-adfc-840226f99010', 'cb340f4e-6bcc-496c-bb7c-e4651c9eab88', 'c56ad05f-893a-49ef-8d4e-a770908a0a9c'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:53 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Delete snapshot completed successfully. Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1efbea81-7ddc-4513-b0be-baeef921e221 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-2349b2e0-a415-4790-8824-c9d165377b93-delete_snapshot" released by "delete_snapshot" :: held 2.523s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:53 devstack sudo[87597]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.486s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:53 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Deleted volume successfully. Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-66029c32-9700-4ad3-84f7-60393d1ec537 tempest-VolumeTypesAccessTest-624572328 None] Lock "cinder-a35da47f-409d-45a6-978b-ac8631abca28-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:53 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.07cf835b-cf46-41d8-bdb8-fe1c071fe06a" returned: 0 in 0.472s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-07cf835b-cf46-41d8-bdb8-fe1c071fe06a" released by "_delete_snapshot" :: held 2.254s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" released by "delete_snapshot" :: held 2.267s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Created reservations ['23459da4-f97d-4743-bcee-4fe452d28de5', '1ab50110-85c2-490a-8fd6-602426dbf582', 'e4f42def-3b84-4224-bb1a-4eca5521a00b', '53bc66fc-b1ba-4f43-9ecf-971e8bd3287a'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:53 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Delete snapshot completed successfully. Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9092ebf-1c18-4fd1-9fef-a6fb6baf0414 tempest-SnapshotsActionsTest-1417303704 None] Lock "cinder-07cf835b-cf46-41d8-bdb8-fe1c071fe06a-delete_snapshot" released by "delete_snapshot" :: held 2.354s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-f48bc9a5-1d27-4de2-aff5-cd59abdf8736-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-f48bc9a5-1d27-4de2-aff5-cd59abdf8736-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-quobyte-f48bc9a5-1d27-4de2-aff5-cd59abdf8736" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-f48bc9a5-1d27-4de2-aff5-cd59abdf8736" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Deleting offline snapshot f48bc9a5-1d27-4de2-aff5-cd59abdf8736 of volume d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] snapshot_file for this snap is: volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[05896c6b-7e0e-44fb-99ee-b27022bd2eb9]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:54 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 Apr 10 10:38:54 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:54 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736" returned: 0 in 0.640s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[129129eb-630c-4460-97e9-37fc2d500c8d]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:54 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb Apr 10 10:38:54 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "cinder-e098d355-0095-4633-b9ee-5d474422acd7-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Lock "cinder-e098d355-0095-4633-b9ee-5d474422acd7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "cinder-quobyte-e098d355-0095-4633-b9ee-5d474422acd7" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Lock "cinder-quobyte-e098d355-0095-4633-b9ee-5d474422acd7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Deleting offline snapshot e098d355-0095-4633-b9ee-5d474422acd7 of volume 833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] snapshot_file for this snap is: volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c93d6bc-6578-440c-b8b0-67aa146f8d89]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:54 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:55 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:55 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb" returned: 0 in 0.683s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:55 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 Apr 10 10:38:55 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:55 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.625s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-833b175f-85f9-4c02-9dff-757b707685af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:38:55 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab47a72-f561-484a-bf23-69d062cc86ae]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:55 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af Apr 10 10:38:55 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:55 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736" returned: 0 in 0.624s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:55 devstack sudo[87629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736 Apr 10 10:38:55 devstack sudo[87629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:56 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af" returned: 0 in 0.656s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:56 devstack sudo[87634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:56 devstack sudo[87634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:56 devstack sudo[87629]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb.f48bc9a5-1d27-4de2-aff5-cd59abdf8736" returned: 0 in 0.552s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-f48bc9a5-1d27-4de2-aff5-cd59abdf8736" released by "_delete_snapshot" :: held 2.578s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" released by "delete_snapshot" :: held 2.591s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:56 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Created reservations ['481599b8-9a13-4070-a9c7-45b9e7d2cf6c', '772ee91b-7235-4b2f-85a6-14e3f5d9af64', 'cd09ba75-4f35-421f-8ab3-51f91a2029f3', '0a1e54ce-4572-4e32-ba08-43550f5a8b33'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:56 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Delete snapshot completed successfully. Apr 10 10:38:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4013732c-b389-426f-a705-f6224e1b5e67 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-f48bc9a5-1d27-4de2-aff5-cd59abdf8736-delete_snapshot" released by "delete_snapshot" :: held 2.705s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:56 devstack sudo[87634]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.567s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:56 devstack sudo[87640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7 Apr 10 10:38:56 devstack sudo[87640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-d66d564c-8747-4efd-b8a4-93ef220e0cbb-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-d66d564c-8747-4efd-b8a4-93ef220e0cbb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58f671b-4d3d-4b6c-b1bd-64fad90648e4]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:57 devstack sudo[87640]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af.e098d355-0095-4633-b9ee-5d474422acd7" returned: 0 in 0.574s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Lock "cinder-quobyte-e098d355-0095-4633-b9ee-5d474422acd7" released by "_delete_snapshot" :: held 2.498s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" released by "delete_snapshot" :: held 2.523s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:57 devstack sudo[87643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb Apr 10 10:38:57 devstack sudo[87643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Created reservations ['29e5c3e7-f773-4067-bee1-d409cc9a79e5', '7af12900-486b-42f5-a2a6-70a68ced4bf0', '4d607c40-da2f-454e-9525-2a5117e5e098', '73e85c9d-ff06-490f-bcf8-753a8af196d0'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:57 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Delete snapshot completed successfully. Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d298f996-243d-4119-954d-219e7abddc2b tempest-SnapshotsActionsTest-1428698067 None] Lock "cinder-e098d355-0095-4633-b9ee-5d474422acd7-delete_snapshot" released by "delete_snapshot" :: held 2.725s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:57 devstack sudo[87643]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb" returned: 0 in 0.609s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:57 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb Apr 10 10:38:57 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "cinder-833b175f-85f9-4c02-9dff-757b707685af-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Lock "cinder-833b175f-85f9-4c02-9dff-757b707685af-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a0b232-0047-4b28-8f65-ec515df722d6]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:58 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af Apr 10 10:38:58 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:58 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d66d564c-8747-4efd-b8a4-93ef220e0cbb" returned: 0 in 0.538s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-quobyte-d66d564c-8747-4efd-b8a4-93ef220e0cbb" released by "delete_volume" :: held 1.179s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Created reservations ['4031cda9-d256-4d52-a0b1-4713cb8bc831', '51fde7af-02ee-4355-811d-6353d609991d', '274647ea-768e-44ee-80d9-cc516ed3e2cd', '16595771-73bd-4cd2-b7b2-e92e8396af1b'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:58 devstack sudo[87653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:58 devstack sudo[87653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:58 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af" returned: 0 in 0.622s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:58 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af Apr 10 10:38:58 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:38:59 devstack sudo[87653]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.530s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:38:59 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Deleted volume successfully. Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d3453a60-f478-4318-8fda-3ea74cc400d6 tempest-VolumesSnapshotListTestJSON-876442528 None] Lock "cinder-d66d564c-8747-4efd-b8a4-93ef220e0cbb-delete_volume" released by "delete_volume" :: held 1.883s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:59 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-833b175f-85f9-4c02-9dff-757b707685af" returned: 0 in 0.540s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Lock "cinder-quobyte-833b175f-85f9-4c02-9dff-757b707685af" released by "delete_volume" :: held 1.199s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Created reservations ['356ff90e-0559-4615-bea1-aee17ecfce46', '429fc146-ab84-4586-8acd-49b7f5d06ff7', 'b1b5fd04-f476-4ac6-9c0f-849e223c49eb', '53f2b56b-6ff0-410f-a2d3-f6c6a8241031'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:38:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:38:59 devstack sudo[87662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:38:59 devstack sudo[87662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:00 devstack sudo[87662]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.629s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:00 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:00 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Deleted volume successfully. Apr 10 10:39:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c94aeb3b-e99e-476d-ba4a-1b70a812c56a tempest-SnapshotsActionsTest-1428698067 None] Lock "cinder-833b175f-85f9-4c02-9dff-757b707685af-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Flow 'volume_create_manager' (d168385f-d941-4870-8893-2a1262f73a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f983b5a-dbaf-4be5-a9d5-67a950769032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f983b5a-dbaf-4be5-a9d5-67a950769032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1064643196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1ee957-3fe5-4c5f-b915-a176e97849e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3676244017e944c6b674700ef3a41069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:02Z,use_quota=True,user_id='2a67c1d83b73428a99061f4b3d641bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689ac6f8-e6d8-4047-8441-69ac0ac3daf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689ac6f8-e6d8-4047-8441-69ac0ac3daf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7f9957-f9f6-4f7f-b4b9-3267a5bde005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae7f9957-f9f6-4f7f-b4b9-3267a5bde005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d1ee957-3fe5-4c5f-b915-a176e97849e2', 'volume_name': 'volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59597c82-183d-44af-81e1-219fce65e0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59597c82-183d-44af-81e1-219fce65e0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbb8465-b81b-4045-87b1-1e35feea1b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:02 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Volume 7d1ee957-3fe5-4c5f-b915-a176e97849e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2', 'volume_size': 1} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1064643196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1ee957-3fe5-4c5f-b915-a176e97849e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3676244017e944c6b674700ef3a41069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:02Z,use_quota=True,user_id='2a67c1d83b73428a99061f4b3d641bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Creating volume 7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:02 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:39:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:02 devstack sudo[87700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 1073741824 Apr 10 10:39:02 devstack sudo[87700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:03 devstack sudo[87700]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 1073741824" returned: 0 in 0.644s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:03 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 Apr 10 10:39:03 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:03 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2" returned: 0 in 0.489s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] <== create_volume: return (1166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cbb8465-b81b-4045-87b1-1e35feea1b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cada5275-a594-4797-8237-d662a33b6a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:03 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Volume volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 (7d1ee957-3fe5-4c5f-b915-a176e97849e2): created successfully Apr 10 10:39:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cada5275-a594-4797-8237-d662a33b6a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Flow 'volume_create_manager' (d168385f-d941-4870-8893-2a1262f73a68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:03 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d602114c-7466-4977-b34b-29f3ad1bc1bb tempest-VolumeDependencyTests-776879590 None] Created volume successfully. Apr 10 10:39:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Creating offline snapshot 52830a6f-8a05-4b3a-82e5-1f62234c95ce of volume 7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:39:04 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[23eafaa9-9dac-4c73-9764-245e610f4d49]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:04 devstack sudo[87710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 Apr 10 10:39:04 devstack sudo[87710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:05 devstack sudo[87710]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2" returned: 0 in 0.561s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:05 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce 1G Apr 10 10:39:05 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:05 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce 1G" returned: 0 in 0.605s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:05 devstack sudo[87721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce Apr 10 10:39:05 devstack sudo[87721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:06 devstack sudo[87721]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce" returned: 0 in 0.524s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:06 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce is being set with open permissions: ugo+rw Apr 10 10:39:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:06 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce Apr 10 10:39:06 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:06 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce" returned: 0 in 0.572s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:06 devstack sudo[87729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.info Apr 10 10:39:06 devstack sudo[87729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:07 devstack sudo[87729]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.info" returned: 0 in 0.593s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:07 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.info is being set with open permissions: ugo+rw Apr 10 10:39:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:07 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.info Apr 10 10:39:07 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:08 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.info" returned: 0 in 0.521s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.443s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:08 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-db162232-915c-4951-8218-f965a9c7f637 tempest-VolumeDependencyTests-776879590 None] Create snapshot completed successfully Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Flow 'volume_create_manager' (2edb6e29-764c-4926-8417-47e0c9e0802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1a9f0e-4db5-4411-a320-ddda5c2698bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1a9f0e-4db5-4411-a320-ddda5c2698bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-944908680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69229837-b53b-4c38-a122-d501ac236b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3676244017e944c6b674700ef3a41069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52830a6f-8a05-4b3a-82e5-1f62234c95ce,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:09Z,use_quota=True,user_id='2a67c1d83b73428a99061f4b3d641bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09911a3f-a475-4585-b250-1cc27fb0f958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09911a3f-a475-4585-b250-1cc27fb0f958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a16322-f549-4a84-b07d-995f7983ad92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1a16322-f549-4a84-b07d-995f7983ad92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69229837-b53b-4c38-a122-d501ac236b55', 'volume_name': 'volume-69229837-b53b-4c38-a122-d501ac236b55', 'volume_size': 1, 'snapshot_id': '52830a6f-8a05-4b3a-82e5-1f62234c95ce'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b07ff8d-71b6-42f2-b24a-6d4f899d4e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b07ff8d-71b6-42f2-b24a-6d4f899d4e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100fbcf6-1fd7-41d9-a12c-c3d7557d686a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Volume 69229837-b53b-4c38-a122-d501ac236b55: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69229837-b53b-4c38-a122-d501ac236b55', 'volume_size': 1, 'snapshot_id': '52830a6f-8a05-4b3a-82e5-1f62234c95ce'} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-quobyte-52830a6f-8a05-4b3a-82e5-1f62234c95ce-69229837-b53b-4c38-a122-d501ac236b55" by "_create_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-52830a6f-8a05-4b3a-82e5-1f62234c95ce-69229837-b53b-4c38-a122-d501ac236b55" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Creating volume 69229837-b53b-4c38-a122-d501ac236b55 from snapshot 52830a6f-8a05-4b3a-82e5-1f62234c95ce {{(pid=82038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-quobyte-69229837-b53b-4c38-a122-d501ac236b55" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-69229837-b53b-4c38-a122-d501ac236b55" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] snapshot: 52830a6f-8a05-4b3a-82e5-1f62234c95ce, volume: 69229837-b53b-4c38-a122-d501ac236b55, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e960f9a-f15b-4559-96ec-d6b1017a19e5]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Flow 'volume_create_manager' (74b31b6a-c455-47ca-b118-cfba4c3cf5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65d1d63-3a04-4e5e-9942-cf5d21311794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65d1d63-3a04-4e5e-9942-cf5d21311794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1199242130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb277e2-08dc-4bc3-8683-50e9a2805612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de53eaab09db4ad882678f47af899170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:09Z,use_quota=True,user_id='bd680254841c4a7a820acfd5b519bc72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008ab13e-b373-4936-8c1f-e344a0a462ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (008ab13e-b373-4936-8c1f-e344a0a462ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0378fec5-2ffb-4291-8a62-a111c763d09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0378fec5-2ffb-4291-8a62-a111c763d09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fb277e2-08dc-4bc3-8683-50e9a2805612', 'volume_name': 'volume-6fb277e2-08dc-4bc3-8683-50e9a2805612', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316f55e4-4d35-477c-8387-67355f4aac3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce Apr 10 10:39:09 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (316f55e4-4d35-477c-8387-67355f4aac3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce39efa5-9ff0-488d-a159-46bd2dd54af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:09 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Volume 6fb277e2-08dc-4bc3-8683-50e9a2805612: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fb277e2-08dc-4bc3-8683-50e9a2805612', 'volume_size': 1} Apr 10 10:39:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:10 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce" returned: 0 in 0.575s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:39:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:39:10 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c038d-2521-43d8-82a3-2b322e8d83f1]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:10 devstack sudo[87740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 Apr 10 10:39:10 devstack sudo[87740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:10 devstack sudo[87740]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2" returned: 0 in 0.537s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:10 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:39:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:10 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 Apr 10 10:39:10 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:12 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55" returned: 0 in 2.254s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:12 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94d7fbe-fa53-4753-9978-1fad521a389c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:12 devstack sudo[87758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 Apr 10 10:39:12 devstack sudo[87758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:13 devstack sudo[87758]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2" returned: 0 in 0.676s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:13 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2, size 1024.00 MB, duration 2.26 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:39:13 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Converted 1024.00 MB image at 453.96 MB/s Apr 10 10:39:13 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 is being set with open permissions: ugo+rw Apr 10 10:39:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:13 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 Apr 10 10:39:13 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:14 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55" returned: 0 in 0.492s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-69229837-b53b-4c38-a122-d501ac236b55" released by "_copy_volume_from_snapshot" :: held 4.613s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-52830a6f-8a05-4b3a-82e5-1f62234c95ce-69229837-b53b-4c38-a122-d501ac236b55" released by "_create_volume_from_snapshot" :: held 4.641s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.652s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.480s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1199242130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fb277e2-08dc-4bc3-8683-50e9a2805612,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de53eaab09db4ad882678f47af899170',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:09Z,use_quota=True,user_id='bd680254841c4a7a820acfd5b519bc72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Creating volume 6fb277e2-08dc-4bc3-8683-50e9a2805612 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:14 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:14 devstack sudo[87766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612 1073741824 Apr 10 10:39:14 devstack sudo[87766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (100fbcf6-1fd7-41d9-a12c-c3d7557d686a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69229837-b53b-4c38-a122-d501ac236b55', 'volume_size': 1, 'snapshot_id': '52830a6f-8a05-4b3a-82e5-1f62234c95ce'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (425fe618-726c-4f17-a231-ec0c21813c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:14 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Volume volume-69229837-b53b-4c38-a122-d501ac236b55 (69229837-b53b-4c38-a122-d501ac236b55): created successfully Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (425fe618-726c-4f17-a231-ec0c21813c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Flow 'volume_create_manager' (2edb6e29-764c-4926-8417-47e0c9e0802f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:14 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-bf437dea-9605-4a42-a899-26ff9b72dd60 tempest-VolumeDependencyTests-776879590 None] Created volume successfully. Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-52830a6f-8a05-4b3a-82e5-1f62234c95ce-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-52830a6f-8a05-4b3a-82e5-1f62234c95ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-quobyte-7d1ee957-3fe5-4c5f-b915-a176e97849e2" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:14 devstack sudo[87766]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612 1073741824" returned: 0 in 0.653s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-7d1ee957-3fe5-4c5f-b915-a176e97849e2" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-quobyte-52830a6f-8a05-4b3a-82e5-1f62234c95ce" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-52830a6f-8a05-4b3a-82e5-1f62234c95ce" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Deleting offline snapshot 52830a6f-8a05-4b3a-82e5-1f62234c95ce of volume 7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:39:14 devstack sudo[87771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612 Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] snapshot_file for this snap is: volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:39:14 devstack sudo[87771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[77996364-f955-4c95-9ee2-76a23db77d62]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:14 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce Apr 10 10:39:14 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:15 devstack sudo[87771]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612" returned: 0 in 0.523s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce39efa5-9ff0-488d-a159-46bd2dd54af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fb277e2-08dc-4bc3-8683-50e9a2805612', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a56df4-9965-41b6-9ff8-59066a80945b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:15 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Volume volume-6fb277e2-08dc-4bc3-8683-50e9a2805612 (6fb277e2-08dc-4bc3-8683-50e9a2805612): created successfully Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7a56df4-9965-41b6-9ff8-59066a80945b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Flow 'volume_create_manager' (74b31b6a-c455-47ca-b118-cfba4c3cf5f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:15 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-85be4c07-ac53-48d3-8adf-721ee73561d4 tempest-VolumesServicesTestJSON-1868185735 None] Created volume successfully. Apr 10 10:39:15 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce" returned: 0 in 0.611s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e41c0d-fbef-4544-97be-e1d23f537bcd]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:15 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 Apr 10 10:39:15 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:15 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2" returned: 0 in 0.563s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:15 devstack sudo[87784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce Apr 10 10:39:15 devstack sudo[87784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Acquiring lock "cinder-6fb277e2-08dc-4bc3-8683-50e9a2805612-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Lock "cinder-6fb277e2-08dc-4bc3-8683-50e9a2805612-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Acquiring lock "cinder-quobyte-6fb277e2-08dc-4bc3-8683-50e9a2805612" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Lock "cinder-quobyte-6fb277e2-08dc-4bc3-8683-50e9a2805612" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:16 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5f6a23-0d51-46a3-b0b9-ff4d5af5f6bb]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:16 devstack sudo[87786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612 Apr 10 10:39:16 devstack sudo[87786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:16 devstack sudo[87784]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce" returned: 0 in 0.656s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:16 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce Apr 10 10:39:16 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:16 devstack sudo[87786]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612" returned: 0 in 0.665s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:16 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612 Apr 10 10:39:16 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:17 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2.52830a6f-8a05-4b3a-82e5-1f62234c95ce" returned: 0 in 0.557s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-52830a6f-8a05-4b3a-82e5-1f62234c95ce" released by "_delete_snapshot" :: held 2.452s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-7d1ee957-3fe5-4c5f-b915-a176e97849e2" released by "delete_snapshot" :: held 2.481s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Created reservations ['24a3a265-80cb-4391-9937-65165b6f7021', 'f5012fa5-0b3e-47fa-ac36-6b01c8cf1cfc', 'a8e85869-e1e0-49c3-9d16-3ffa6058062f', '5f6c704f-e89d-4406-b7e4-299ead1ca44d'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:17 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Delete snapshot completed successfully. Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-51b8cdd2-d219-4041-a2be-088249aab741 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-52830a6f-8a05-4b3a-82e5-1f62234c95ce-delete_snapshot" released by "delete_snapshot" :: held 2.624s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:17 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6fb277e2-08dc-4bc3-8683-50e9a2805612" returned: 0 in 0.473s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Lock "cinder-quobyte-6fb277e2-08dc-4bc3-8683-50e9a2805612" released by "delete_volume" :: held 1.161s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Created reservations ['5dc373ff-c5e7-479c-af08-b3b87819dc85', 'afa10a1e-465f-4c71-b18e-016270a1c81f', '683cbd07-876f-4470-9ece-c73e977f45f9', '75a19a01-a7b1-4e19-bb8d-7a27a916f492'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:17 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:39:17 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-7d1ee957-3fe5-4c5f-b915-a176e97849e2-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-7d1ee957-3fe5-4c5f-b915-a176e97849e2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-quobyte-7d1ee957-3fe5-4c5f-b915-a176e97849e2" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-7d1ee957-3fe5-4c5f-b915-a176e97849e2" acquired by "delete_volume" :: waited 0.019s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[859cf03c-db08-4fb8-889f-e8ec6a81ef54]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:18 devstack sudo[87803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 Apr 10 10:39:18 devstack sudo[87803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:18 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.535s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:18 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:18 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Deleted volume successfully. Apr 10 10:39:18 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7aa29402-ad5d-4aa0-b670-07de7a6a975e tempest-VolumesServicesTestJSON-1868185735 None] Lock "cinder-6fb277e2-08dc-4bc3-8683-50e9a2805612-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:18 devstack sudo[87803]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2" returned: 0 in 0.609s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:18 devstack sudo[87809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2 Apr 10 10:39:18 devstack sudo[87809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:19 devstack sudo[87809]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7d1ee957-3fe5-4c5f-b915-a176e97849e2" returned: 0 in 0.486s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-7d1ee957-3fe5-4c5f-b915-a176e97849e2" released by "delete_volume" :: held 1.128s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Created reservations ['33f9a54b-4c95-477b-8774-ed5dddbda1c9', '29e85ce6-3870-4d97-9ac7-44203059e4b5', 'c26b2909-3a1b-4dc7-839d-4dd9f8e9912c', 'ef63ea87-81fb-415e-b754-838ab7692f67'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:19 devstack sudo[87812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:39:19 devstack sudo[87812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:19 devstack sudo[87812]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.571s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:19 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Deleted volume successfully. Apr 10 10:39:19 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-37a0e030-4dd6-4104-8f5d-6511d024c523 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-7d1ee957-3fe5-4c5f-b915-a176e97849e2-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Flow 'volume_create_manager' (9e8a2ad2-1f65-47da-bd34-822024a4efae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6672241-0d46-4984-8401-871a452a5839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6672241-0d46-4984-8401-871a452a5839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-536748728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341c3777-4cdf-4344-8f10-d7408c8d6f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3676244017e944c6b674700ef3a41069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:20Z,use_quota=True,user_id='2a67c1d83b73428a99061f4b3d641bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b83ba4-ef43-455f-8d6b-92890d651af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b83ba4-ef43-455f-8d6b-92890d651af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938507e6-ca34-456b-b5e5-d4de0654ba92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938507e6-ca34-456b-b5e5-d4de0654ba92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '341c3777-4cdf-4344-8f10-d7408c8d6f91', 'volume_name': 'volume-341c3777-4cdf-4344-8f10-d7408c8d6f91', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843fc777-c4cb-4b2b-a74b-5ad8b99f6b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (843fc777-c4cb-4b2b-a74b-5ad8b99f6b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a59cb82-95b1-4e4d-9da9-293f6e6dfa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:20 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Volume 341c3777-4cdf-4344-8f10-d7408c8d6f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-341c3777-4cdf-4344-8f10-d7408c8d6f91', 'volume_size': 1} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-536748728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=341c3777-4cdf-4344-8f10-d7408c8d6f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3676244017e944c6b674700ef3a41069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:20Z,use_quota=True,user_id='2a67c1d83b73428a99061f4b3d641bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Creating volume 341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:20 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:39:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:20 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 1073741824 Apr 10 10:39:20 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:21 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 1073741824" returned: 0 in 0.633s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:21 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 Apr 10 10:39:21 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:21 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91" returned: 0 in 0.505s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a59cb82-95b1-4e4d-9da9-293f6e6dfa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-341c3777-4cdf-4344-8f10-d7408c8d6f91', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3238cb-4ddc-48b2-99c1-92be438e1e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:21 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Volume volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 (341c3777-4cdf-4344-8f10-d7408c8d6f91): created successfully Apr 10 10:39:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3238cb-4ddc-48b2-99c1-92be438e1e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Flow 'volume_create_manager' (9e8a2ad2-1f65-47da-bd34-822024a4efae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:21 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ab431dc7-bb4f-463a-9fd7-4c690c667752 tempest-VolumeDependencyTests-776879590 None] Created volume successfully. Apr 10 10:39:22 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Flow 'volume_create_manager' (a4a2819e-b851-4cc2-8d0c-7013ae171d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf3ed03-b10d-4d92-9b37-5d2e516ee871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cf3ed03-b10d-4d92-9b37-5d2e516ee871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-792251726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff88f74-3241-4d3b-9c12-5a10180c5ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3676244017e944c6b674700ef3a41069',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=341c3777-4cdf-4344-8f10-d7408c8d6f91,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:23Z,use_quota=True,user_id='2a67c1d83b73428a99061f4b3d641bd6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4637a171-dbee-4597-b949-979aa0704169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4637a171-dbee-4597-b949-979aa0704169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fffd5e7-3b91-48c5-8506-15bb5f57366c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fffd5e7-3b91-48c5-8506-15bb5f57366c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'aff88f74-3241-4d3b-9c12-5a10180c5ba7', 'volume_name': 'volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7', 'volume_size': 1, 'source_volid': '341c3777-4cdf-4344-8f10-d7408c8d6f91', 'source_volstatus': 'available'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b7b10a-5dce-462f-a1c3-2326cdb77e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90b7b10a-5dce-462f-a1c3-2326cdb77e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:23 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa132dbf-d58f-4ccb-8f2c-f4ef8fac2b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:23 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Volume aff88f74-3241-4d3b-9c12-5a10180c5ba7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7', 'volume_size': 1, 'source_volid': '341c3777-4cdf-4344-8f10-d7408c8d6f91', 'source_volstatus': 'available'} Apr 10 10:39:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:23 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Cloning volume 341c3777-4cdf-4344-8f10-d7408c8d6f91 to volume aff88f74-3241-4d3b-9c12-5a10180c5ba7 Apr 10 10:39:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Creating offline snapshot c97dcdb7-3f80-4e85-9e3b-6f7c7384806d of volume 341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:39:23 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8709dfb4-8390-453a-9b6b-a540695eec00]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:23 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 Apr 10 10:39:23 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:23 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91" returned: 0 in 0.666s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:23 devstack sudo[87829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d 1G Apr 10 10:39:23 devstack sudo[87829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:24 devstack sudo[87829]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d 1G" returned: 0 in 0.626s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:24 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d Apr 10 10:39:24 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:24 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d" returned: 0 in 0.539s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:24 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d is being set with open permissions: ugo+rw Apr 10 10:39:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:24 devstack sudo[87839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d Apr 10 10:39:24 devstack sudo[87839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:25 devstack sudo[87839]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d" returned: 0 in 0.540s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:25 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.info Apr 10 10:39:25 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:26 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.info" returned: 0 in 0.585s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:26 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.info is being set with open permissions: ugo+rw Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:26 devstack sudo[87845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.info Apr 10 10:39:26 devstack sudo[87845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:26 devstack sudo[87845]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.info" returned: 0 in 0.611s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-quobyte-aff88f74-3241-4d3b-9c12-5a10180c5ba7" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-aff88f74-3241-4d3b-9c12-5a10180c5ba7" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] snapshot: c97dcdb7-3f80-4e85-9e3b-6f7c7384806d, volume: aff88f74-3241-4d3b-9c12-5a10180c5ba7, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dc4f7d-2ba3-4f5c-916c-1f1a7bc716d3]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:26 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d Apr 10 10:39:26 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:27 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d" returned: 0 in 0.611s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-341c3777-4cdf-4344-8f10-d7408c8d6f91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:39:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:39:27 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[970324dd-e4ab-41d4-85c6-d4d993beecf9]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:27 devstack sudo[87853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 Apr 10 10:39:27 devstack sudo[87853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:28 devstack sudo[87853]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91" returned: 0 in 0.623s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:28 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:39:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:28 devstack sudo[87858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 Apr 10 10:39:28 devstack sudo[87858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Flow 'volume_create_manager' (672a8fc7-ec62-495d-8724-56b12ba94f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cefea3-9662-4f4d-8d12-c04844cdc8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56cefea3-9662-4f4d-8d12-c04844cdc8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1892605100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29f64c7-2164-412e-b527-152784119ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0af1906fe7748c1807138a101538a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:29Z,use_quota=True,user_id='9133463fa0cf4b8cb336b85cd8766fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac50e34-9b51-44ce-afad-746ea775d9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cac50e34-9b51-44ce-afad-746ea775d9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6789162b-a59c-4130-809c-b81b0dddb08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6789162b-a59c-4130-809c-b81b0dddb08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29f64c7-2164-412e-b527-152784119ec8', 'volume_name': 'volume-c29f64c7-2164-412e-b527-152784119ec8', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6bc55f-8f7d-4ab6-ad17-7b0c4f85cebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c6bc55f-8f7d-4ab6-ad17-7b0c4f85cebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0343ef53-db16-47d2-ba10-27abf84b2e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:29 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Volume c29f64c7-2164-412e-b527-152784119ec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29f64c7-2164-412e-b527-152784119ec8', 'volume_size': 1} Apr 10 10:39:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:30 devstack sudo[87858]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7" returned: 0 in 2.424s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:30 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d38b06-11a5-4a3b-a2af-730dc5caa235]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:30 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 Apr 10 10:39:30 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:31 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91" returned: 0 in 0.670s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:39:31 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Converted 1024.00 MB image at 422.38 MB/s Apr 10 10:39:31 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 is being set with open permissions: ugo+rw Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:31 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 Apr 10 10:39:31 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:31 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7" returned: 0 in 0.421s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-aff88f74-3241-4d3b-9c12-5a10180c5ba7" released by "_copy_volume_from_snapshot" :: held 4.818s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-quobyte-c97dcdb7-3f80-4e85-9e3b-6f7c7384806d" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-c97dcdb7-3f80-4e85-9e3b-6f7c7384806d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Deleting offline snapshot c97dcdb7-3f80-4e85-9e3b-6f7c7384806d of volume 341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] snapshot_file for this snap is: volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb349e4-2198-4aa6-9ae4-863a2bc9e88d]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:31 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d Apr 10 10:39:31 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:32 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d" returned: 0 in 0.493s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-341c3777-4cdf-4344-8f10-d7408c8d6f91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:39:32 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a852b5-47b1-4018-95b5-c27bffdd9fd8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:32 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 Apr 10 10:39:32 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:32 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91" returned: 0 in 0.505s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:32 devstack sudo[87891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d Apr 10 10:39:32 devstack sudo[87891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:33 devstack sudo[87891]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d" returned: 0 in 0.498s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:33 devstack sudo[87896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d Apr 10 10:39:33 devstack sudo[87896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:33 devstack sudo[87896]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91.c97dcdb7-3f80-4e85-9e3b-6f7c7384806d" returned: 0 in 0.441s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-c97dcdb7-3f80-4e85-9e3b-6f7c7384806d" released by "_delete_snapshot" :: held 1.985s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.568s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.800s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1892605100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29f64c7-2164-412e-b527-152784119ec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d0af1906fe7748c1807138a101538a6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:29Z,use_quota=True,user_id='9133463fa0cf4b8cb336b85cd8766fa5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Creating volume c29f64c7-2164-412e-b527-152784119ec8 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:33 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa132dbf-d58f-4ccb-8f2c-f4ef8fac2b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7', 'volume_size': 1, 'source_volid': '341c3777-4cdf-4344-8f10-d7408c8d6f91', 'source_volstatus': 'available'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734b933d-20ad-4880-a876-c23670056540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:33 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8 1073741824 Apr 10 10:39:33 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:33 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Volume volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 (aff88f74-3241-4d3b-9c12-5a10180c5ba7): created successfully Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (734b933d-20ad-4880-a876-c23670056540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Flow 'volume_create_manager' (a4a2819e-b851-4cc2-8d0c-7013ae171d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:33 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-89ec1393-259f-4d82-a76a-41725e8c222f tempest-VolumeDependencyTests-776879590 None] Created volume successfully. Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-341c3777-4cdf-4344-8f10-d7408c8d6f91-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-341c3777-4cdf-4344-8f10-d7408c8d6f91-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-quobyte-341c3777-4cdf-4344-8f10-d7408c8d6f91" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-341c3777-4cdf-4344-8f10-d7408c8d6f91" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43ddeb4-b60b-4cab-98ea-eece1e398fdc]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:33 devstack sudo[87903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 Apr 10 10:39:33 devstack sudo[87903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:34 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8 1073741824" returned: 0 in 0.750s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:34 devstack sudo[87909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8 Apr 10 10:39:34 devstack sudo[87909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:34 devstack sudo[87903]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91" returned: 0 in 0.640s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:34 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91 Apr 10 10:39:34 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:34 devstack sudo[87909]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8" returned: 0 in 0.482s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0343ef53-db16-47d2-ba10-27abf84b2e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29f64c7-2164-412e-b527-152784119ec8', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99375321-ea38-43b4-80ce-9a98cf72289a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:34 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Volume volume-c29f64c7-2164-412e-b527-152784119ec8 (c29f64c7-2164-412e-b527-152784119ec8): created successfully Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99375321-ea38-43b4-80ce-9a98cf72289a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Flow 'volume_create_manager' (672a8fc7-ec62-495d-8724-56b12ba94f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:34 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a5a0f15c-5e42-4cf0-8776-4912bdd4ed91 tempest-AbsoluteLimitsTests-1180870827 None] Created volume successfully. Apr 10 10:39:35 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-341c3777-4cdf-4344-8f10-d7408c8d6f91" returned: 0 in 0.570s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-341c3777-4cdf-4344-8f10-d7408c8d6f91" released by "delete_volume" :: held 1.247s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Created reservations ['fef5ebd2-ebb4-4469-a590-3c7868e4b6e8', '9e399652-05ba-44de-bc88-c046405e9724', '00792775-6076-4972-a598-c4ae1f9812a3', '8e798a7b-df3c-49c0-be4f-fbcdf3ec539f'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:35 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:39:35 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:35 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.456s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:35 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Deleted volume successfully. Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c4ce06b2-5764-4049-b1af-dd594e261474 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-341c3777-4cdf-4344-8f10-d7408c8d6f91-delete_volume" released by "delete_volume" :: held 1.836s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Acquiring lock "cinder-c29f64c7-2164-412e-b527-152784119ec8-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Lock "cinder-c29f64c7-2164-412e-b527-152784119ec8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Acquiring lock "cinder-quobyte-c29f64c7-2164-412e-b527-152784119ec8" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Lock "cinder-quobyte-c29f64c7-2164-412e-b527-152784119ec8" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d027a58-83b7-40d7-b2ff-5c47ac96ba28]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:35 devstack sudo[87936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8 Apr 10 10:39:35 devstack sudo[87936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-aff88f74-3241-4d3b-9c12-5a10180c5ba7-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-aff88f74-3241-4d3b-9c12-5a10180c5ba7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-quobyte-aff88f74-3241-4d3b-9c12-5a10180c5ba7" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-aff88f74-3241-4d3b-9c12-5a10180c5ba7" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:36 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd804a5-c12a-464a-894c-39df4d425c06]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:36 devstack sudo[87938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 Apr 10 10:39:36 devstack sudo[87938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:36 devstack sudo[87936]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8" returned: 0 in 0.554s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:36 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8 Apr 10 10:39:36 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:36 devstack sudo[87938]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7" returned: 0 in 0.564s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:36 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7 Apr 10 10:39:36 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:37 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c29f64c7-2164-412e-b527-152784119ec8" returned: 0 in 0.559s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Lock "cinder-quobyte-c29f64c7-2164-412e-b527-152784119ec8" released by "delete_volume" :: held 1.137s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=109,cinder:INSERT=42,cinder:UPDATE=131,cinder:DELETE=8 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=110,cinder:UPDATE=130,cinder:DELETE=13,cinder:INSERT=28 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Created reservations ['251615eb-8ee2-4894-8b64-6523048be074', '8c14f3e4-2562-46b7-8545-24b11963ba07', '70029d88-8462-4cbe-a2dd-bdb4b969a860', 'e115823c-4917-4fd4-a96c-fc161b10be17'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:37 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-aff88f74-3241-4d3b-9c12-5a10180c5ba7" returned: 0 in 0.540s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:37 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-aff88f74-3241-4d3b-9c12-5a10180c5ba7" released by "delete_volume" :: held 1.130s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:37 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Created reservations ['9a0a494f-9ed6-4278-a091-3a746c11cb7c', '9e0365cb-13f9-40e4-9089-15db1766548e', '994de7f5-eff7-400b-b226-96f988d696a3', '9282ae7e-b6a9-4ad6-a123-a292a2c54c7f'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:37 devstack sudo[87954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:39:37 devstack sudo[87954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:37 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.443s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:37 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Deleted volume successfully. Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-2a8b67ea-2183-46e9-8c2a-7f3e0d069e8d tempest-AbsoluteLimitsTests-1180870827 None] Lock "cinder-c29f64c7-2164-412e-b527-152784119ec8-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:37 devstack sudo[87954]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.489s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:37 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Deleted volume successfully. Apr 10 10:39:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f3ec6e07-99ea-4ce7-9f91-ea57bc1b1fc0 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-aff88f74-3241-4d3b-9c12-5a10180c5ba7-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-69229837-b53b-4c38-a122-d501ac236b55-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-69229837-b53b-4c38-a122-d501ac236b55-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "cinder-quobyte-69229837-b53b-4c38-a122-d501ac236b55" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-69229837-b53b-4c38-a122-d501ac236b55" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:38 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdc7110-1acd-4847-ad77-9e71345da59e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:38 devstack sudo[87961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 Apr 10 10:39:38 devstack sudo[87961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:38 devstack sudo[87961]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55" returned: 0 in 0.601s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:38 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55 Apr 10 10:39:38 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:39 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:39:39 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:39 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-69229837-b53b-4c38-a122-d501ac236b55" returned: 0 in 0.556s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-quobyte-69229837-b53b-4c38-a122-d501ac236b55" released by "delete_volume" :: held 1.201s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Created reservations ['30a91ead-b49c-4acc-92ff-46178d6c5e1f', '86e94e52-0ab9-46a4-b1e7-52992cee8f53', 'edf140d6-f8c8-46a1-b60d-9d8132d66473', 'bc72153e-291e-4bbb-89ae-2a28d3ea40ad'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:39 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:39:39 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:39 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.501s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:39 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:40 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.591s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:40 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:40 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Deleted volume successfully. Apr 10 10:39:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-75fa1ee0-12ca-4070-b13f-797645f256f9 tempest-VolumeDependencyTests-776879590 None] Lock "cinder-69229837-b53b-4c38-a122-d501ac236b55-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Flow 'volume_create_manager' (1780f321-8cd0-4a4c-8e2f-8a4dcb776e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25eff5e9-8e8a-4d56-95d2-8b254ed48ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25eff5e9-8e8a-4d56-95d2-8b254ed48ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1608005614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9988aa-90c1-4ce8-a140-3751d675f6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c171746e958545b7af1903c5b3aada91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:43Z,use_quota=True,user_id='53355a893f034670ac496601c929eeb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bce7f9-8894-4309-90ab-9e74c5af7173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89bce7f9-8894-4309-90ab-9e74c5af7173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe99f7b-7b81-43a5-bff6-eab18156f389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe99f7b-7b81-43a5-bff6-eab18156f389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a9988aa-90c1-4ce8-a140-3751d675f6a1', 'volume_name': 'volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ab973a-ea35-40d8-b526-e62959df412f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ab973a-ea35-40d8-b526-e62959df412f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d2b068-947b-4e99-a73a-1be4b0e84f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:43 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Volume 0a9988aa-90c1-4ce8-a140-3751d675f6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1', 'volume_size': 1} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1608005614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a9988aa-90c1-4ce8-a140-3751d675f6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c171746e958545b7af1903c5b3aada91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:43Z,use_quota=True,user_id='53355a893f034670ac496601c929eeb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Creating volume 0a9988aa-90c1-4ce8-a140-3751d675f6a1 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:43 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:43 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1 1073741824 Apr 10 10:39:43 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (af53e68f-9f1a-4c45-afa0-413f29f8bfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a50fa0-c69d-4449-b4d5-dcec0f0f8f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a50fa0-c69d-4449-b4d5-dcec0f0f8f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1962118819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4789264-38f9-4322-9dc4-57196625578a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:44Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97689fc0-3fda-4a53-8b87-631136db6d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97689fc0-3fda-4a53-8b87-631136db6d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea1ea97-6c82-4c4b-91fd-b16d91700091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ea1ea97-6c82-4c4b-91fd-b16d91700091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4789264-38f9-4322-9dc4-57196625578a', 'volume_name': 'volume-a4789264-38f9-4322-9dc4-57196625578a', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ab3d52-941d-491a-bc86-7d5968f7b53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55ab3d52-941d-491a-bc86-7d5968f7b53e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755ebd7a-2bd6-488f-b1c0-f15f595f87c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:43 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Volume a4789264-38f9-4322-9dc4-57196625578a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4789264-38f9-4322-9dc4-57196625578a', 'volume_size': 1} Apr 10 10:39:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:44 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1 1073741824" returned: 0 in 0.593s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:44 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1 Apr 10 10:39:44 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:44 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1" returned: 0 in 0.461s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.919s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1962118819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4789264-38f9-4322-9dc4-57196625578a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:44Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Creating volume a4789264-38f9-4322-9dc4-57196625578a {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:44 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:44 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a 1073741824 Apr 10 10:39:44 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85d2b068-947b-4e99-a73a-1be4b0e84f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3534f7fc-05b3-498f-b4ad-87ffd4ff91a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:44 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Volume volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1 (0a9988aa-90c1-4ce8-a140-3751d675f6a1): created successfully Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3534f7fc-05b3-498f-b4ad-87ffd4ff91a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Flow 'volume_create_manager' (1780f321-8cd0-4a4c-8e2f-8a4dcb776e00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-2c6cb965-d9a6-4656-8317-744b94874792 tempest-VolumesTransfersV357Test-652949949 None] Created volume successfully. Apr 10 10:39:45 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a 1073741824" returned: 0 in 0.537s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:45 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a Apr 10 10:39:45 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:45 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a" returned: 0 in 0.440s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (755ebd7a-2bd6-488f-b1c0-f15f595f87c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4789264-38f9-4322-9dc4-57196625578a', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46ab3ba-2d89-4b47-bad0-2ad9c3f72269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:45 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Volume volume-a4789264-38f9-4322-9dc4-57196625578a (a4789264-38f9-4322-9dc4-57196625578a): created successfully Apr 10 10:39:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c46ab3ba-2d89-4b47-bad0-2ad9c3f72269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (af53e68f-9f1a-4c45-afa0-413f29f8bfbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:45 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0395f743-f203-44d3-ad30-cec8bb1c11a2 tempest-VolumesActionsTest-1696777940 None] Created volume successfully. Apr 10 10:39:46 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f3bbd835-8d3a-4e03-8dfb-cce320d66258 tempest-VolumesTransfersV357Test-1645804634 None] Transfer volume completed successfully. Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Acquiring lock "cinder-0a9988aa-90c1-4ce8-a140-3751d675f6a1-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Lock "cinder-0a9988aa-90c1-4ce8-a140-3751d675f6a1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Acquiring lock "cinder-quobyte-0a9988aa-90c1-4ce8-a140-3751d675f6a1" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Lock "cinder-quobyte-0a9988aa-90c1-4ce8-a140-3751d675f6a1" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad4e724-3df2-465e-8e38-f47ebfabf059]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-98472eff-6781-4c10-a996-b31974d972e3 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "cinder-a4789264-38f9-4322-9dc4-57196625578a" by "attach_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-98472eff-6781-4c10-a996-b31974d972e3 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-a4789264-38f9-4322-9dc4-57196625578a" acquired by "attach_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:47 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1 Apr 10 10:39:47 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-98472eff-6781-4c10-a996-b31974d972e3 tempest-VolumesActionsTest-1696777940 None] Attaching volume a4789264-38f9-4322-9dc4-57196625578a to instance ba0752f9-3fa9-4707-a1b8-27ecda218461 at mountpoint /dev/vdb on host None. Apr 10 10:39:47 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-98472eff-6781-4c10-a996-b31974d972e3 tempest-VolumesActionsTest-1696777940 None] Attach volume completed successfully. Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-98472eff-6781-4c10-a996-b31974d972e3 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-a4789264-38f9-4322-9dc4-57196625578a" released by "attach_volume" :: held 0.076s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:47 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1" returned: 0 in 0.587s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:47 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1 Apr 10 10:39:47 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-13ef97de-6d44-452c-8559-bb108874702e tempest-VolumesActionsTest-413421 None] Terminate volume connection completed successfully. Apr 10 10:39:48 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a9988aa-90c1-4ce8-a140-3751d675f6a1" returned: 0 in 0.492s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Lock "cinder-quobyte-0a9988aa-90c1-4ce8-a140-3751d675f6a1" released by "delete_volume" :: held 1.106s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Created reservations ['41e85e45-a3a0-4885-b3a2-98e585f28452', '6bcc88f5-744d-4c07-8440-81c49a66a2cc', '0d2d0143-c5a2-439c-a6e3-fabee9cb344e', '78fcba01-eead-4239-9dd8-d7057423ed37'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:48 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:39:48 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-13ef97de-6d44-452c-8559-bb108874702e tempest-VolumesActionsTest-413421 None] Acquiring lock "cinder-a4789264-38f9-4322-9dc4-57196625578a-detach_volume" by "detach_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-13ef97de-6d44-452c-8559-bb108874702e tempest-VolumesActionsTest-413421 None] Lock "cinder-a4789264-38f9-4322-9dc4-57196625578a-detach_volume" acquired by "detach_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-13ef97de-6d44-452c-8559-bb108874702e tempest-VolumesActionsTest-413421 None] Detaching volume a4789264-38f9-4322-9dc4-57196625578a from instance ba0752f9-3fa9-4707-a1b8-27ecda218461. Apr 10 10:39:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-13ef97de-6d44-452c-8559-bb108874702e tempest-VolumesActionsTest-413421 None] Detach volume completed successfully. Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-13ef97de-6d44-452c-8559-bb108874702e tempest-VolumesActionsTest-413421 None] Lock "cinder-a4789264-38f9-4322-9dc4-57196625578a-detach_volume" released by "detach_volume" :: held 0.060s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:48 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.508s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Deleted volume successfully. Apr 10 10:39:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5696b606-e06a-4297-a966-a571ce2e2a27 tempest-VolumesTransfersV357Test-1893447334 None] Lock "cinder-0a9988aa-90c1-4ce8-a140-3751d675f6a1-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-17695a4e-acc1-4d91-a7c5-7f79613201e9 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "cinder-a4789264-38f9-4322-9dc4-57196625578a-detach_volume" by "detach_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-17695a4e-acc1-4d91-a7c5-7f79613201e9 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-a4789264-38f9-4322-9dc4-57196625578a-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:49 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-17695a4e-acc1-4d91-a7c5-7f79613201e9 tempest-VolumesActionsTest-1696777940 None] Volume detach called, but volume not attached. Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-17695a4e-acc1-4d91-a7c5-7f79613201e9 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-a4789264-38f9-4322-9dc4-57196625578a-detach_volume" released by "detach_volume" :: held 0.013s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Flow 'volume_create_manager' (1abacdc2-e0ec-45a1-91f4-b5270f843c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c03288-0132-4e4b-8abf-1402ab4a9416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8c03288-0132-4e4b-8abf-1402ab4a9416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-176535335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a763f6d-0540-4b85-8024-c326d9c85566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c171746e958545b7af1903c5b3aada91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:49Z,use_quota=True,user_id='53355a893f034670ac496601c929eeb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a9e25f-a141-4031-9ae7-c85a325c1ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9a9e25f-a141-4031-9ae7-c85a325c1ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ae024d-0eb0-458e-b2aa-cb05342d9852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ae024d-0eb0-458e-b2aa-cb05342d9852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a763f6d-0540-4b85-8024-c326d9c85566', 'volume_name': 'volume-0a763f6d-0540-4b85-8024-c326d9c85566', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfce7b6b-b21e-4c9a-a7bd-7d78158e13c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfce7b6b-b21e-4c9a-a7bd-7d78158e13c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8082868d-34ca-41e4-bfe4-1835720e199b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:49 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Volume 0a763f6d-0540-4b85-8024-c326d9c85566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a763f6d-0540-4b85-8024-c326d9c85566', 'volume_size': 1} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-176535335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a763f6d-0540-4b85-8024-c326d9c85566,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c171746e958545b7af1903c5b3aada91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:49Z,use_quota=True,user_id='53355a893f034670ac496601c929eeb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Creating volume 0a763f6d-0540-4b85-8024-c326d9c85566 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:49 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:49 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566 1073741824 Apr 10 10:39:49 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "cinder-a4789264-38f9-4322-9dc4-57196625578a-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-a4789264-38f9-4322-9dc4-57196625578a-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "cinder-quobyte-a4789264-38f9-4322-9dc4-57196625578a" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-quobyte-a4789264-38f9-4322-9dc4-57196625578a" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ccd888-9a2f-4151-aa64-5a071c64fc3f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:50 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a Apr 10 10:39:50 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:50 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566 1073741824" returned: 0 in 0.582s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:50 devstack sudo[88049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566 Apr 10 10:39:50 devstack sudo[88049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:50 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a" returned: 0 in 0.579s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:50 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a Apr 10 10:39:50 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:50 devstack sudo[88049]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566" returned: 0 in 0.500s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8082868d-34ca-41e4-bfe4-1835720e199b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a763f6d-0540-4b85-8024-c326d9c85566', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e63a48-ea72-4f6d-9835-a24e30e5ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:50 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Volume volume-0a763f6d-0540-4b85-8024-c326d9c85566 (0a763f6d-0540-4b85-8024-c326d9c85566): created successfully Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6e63a48-ea72-4f6d-9835-a24e30e5ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Flow 'volume_create_manager' (1abacdc2-e0ec-45a1-91f4-b5270f843c07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:50 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-071f428c-2261-4592-a15c-aef82dd20fc5 tempest-VolumesTransfersV357Test-652949949 None] Created volume successfully. Apr 10 10:39:51 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a4789264-38f9-4322-9dc4-57196625578a" returned: 0 in 0.485s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-quobyte-a4789264-38f9-4322-9dc4-57196625578a" released by "delete_volume" :: held 1.106s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Created reservations ['e1cbc212-14c2-4e03-9b89-379a26ba58e8', '211e725c-8ab4-4659-b7a7-b04afac99a41', '934e4856-48cf-4e37-9b07-675bea86da27', '94ed793e-2ce3-4d0e-be44-01dc397de6af'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:51 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:39:51 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:51 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.420s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:51 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Deleted volume successfully. Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-774a0de2-ec1b-4e1b-a257-757b761d0bb1 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-a4789264-38f9-4322-9dc4-57196625578a-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Acquiring lock "cinder-0a763f6d-0540-4b85-8024-c326d9c85566-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Lock "cinder-0a763f6d-0540-4b85-8024-c326d9c85566-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Acquiring lock "cinder-quobyte-0a763f6d-0540-4b85-8024-c326d9c85566" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Lock "cinder-quobyte-0a763f6d-0540-4b85-8024-c326d9c85566" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[05128552-b93d-47e1-a488-5a5aaf0be41b]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:39:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:52 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566 Apr 10 10:39:52 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:52 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566" returned: 0 in 0.560s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:52 devstack sudo[88067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566 Apr 10 10:39:52 devstack sudo[88067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:53 devstack sudo[88067]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0a763f6d-0540-4b85-8024-c326d9c85566" returned: 0 in 0.491s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Lock "cinder-quobyte-0a763f6d-0540-4b85-8024-c326d9c85566" released by "delete_volume" :: held 1.087s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Created reservations ['da3e5e1a-f83e-4340-9c4d-dc4962d48171', '23328117-dfaf-4a9d-8471-dbef83893690', 'c47b07f6-6b8a-4241-8216-d87f692e0c49', '0a1c4d20-401c-4bdb-a9a3-c61b1c7c37e8'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:53 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:39:53 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:53 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.548s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:39:53 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Deleted volume successfully. Apr 10 10:39:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-07892cd9-f474-4eed-b1b0-4fec52cd6616 tempest-VolumesTransfersV357Test-1893447334 None] Lock "cinder-0a763f6d-0540-4b85-8024-c326d9c85566-delete_volume" released by "delete_volume" :: held 1.794s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (b0c89668-f4a0-407f-beff-e632b25413b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8deb59-8837-4d73-9365-3a9631191f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b8deb59-8837-4d73-9365-3a9631191f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2074947160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650c7bdf-ef47-455d-9635-a449dd2e56fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:59Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12e91a0-6a2d-41e9-a8a1-e619217cd6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a12e91a0-6a2d-41e9-a8a1-e619217cd6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1b7bad-0667-45ad-95a2-0bfd9d5a9cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc1b7bad-0667-45ad-95a2-0bfd9d5a9cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '650c7bdf-ef47-455d-9635-a449dd2e56fa', 'volume_name': 'volume-650c7bdf-ef47-455d-9635-a449dd2e56fa', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a10f4be-6de8-44d1-bd44-d56cb3822460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a10f4be-6de8-44d1-bd44-d56cb3822460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978283d9-350c-455a-9fec-a9c2bb8ecbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:58 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Volume 650c7bdf-ef47-455d-9635-a449dd2e56fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-650c7bdf-ef47-455d-9635-a449dd2e56fa', 'volume_size': 1} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:39:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2074947160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=650c7bdf-ef47-455d-9635-a449dd2e56fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:39:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:39:59Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Creating volume 650c7bdf-ef47-455d-9635-a449dd2e56fa {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:39:58 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:39:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:58 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa 1073741824 Apr 10 10:39:58 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:59 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa 1073741824" returned: 0 in 0.573s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:39:59 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa Apr 10 10:39:59 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:39:59 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 10 10:39:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa" returned: 0 in 0.470s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:39:59 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:39:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:39:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978283d9-350c-455a-9fec-a9c2bb8ecbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-650c7bdf-ef47-455d-9635-a449dd2e56fa', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c8ae13-3368-4a76-94f9-a3e5ed6d0268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:39:59 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Volume volume-650c7bdf-ef47-455d-9635-a449dd2e56fa (650c7bdf-ef47-455d-9635-a449dd2e56fa): created successfully Apr 10 10:39:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c8ae13-3368-4a76-94f9-a3e5ed6d0268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:39:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (b0c89668-f4a0-407f-beff-e632b25413b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:39:59 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-83ce157c-2cbe-4582-a3fd-ba4adebf98f1 tempest-VolumesActionsTest-1696777940 None] Created volume successfully. Apr 10 10:40:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Acquiring lock "cinder-650c7bdf-ef47-455d-9635-a449dd2e56fa-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Lock "cinder-650c7bdf-ef47-455d-9635-a449dd2e56fa-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Acquiring lock "cinder-quobyte-650c7bdf-ef47-455d-9635-a449dd2e56fa" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Lock "cinder-quobyte-650c7bdf-ef47-455d-9635-a449dd2e56fa" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:01 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[827fdd35-27cc-44be-b533-50c8424de1d7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:01 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa Apr 10 10:40:01 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:01 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa" returned: 0 in 0.552s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:01 devstack sudo[88146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa Apr 10 10:40:01 devstack sudo[88146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:02 devstack sudo[88146]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-650c7bdf-ef47-455d-9635-a449dd2e56fa" returned: 0 in 0.506s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Lock "cinder-quobyte-650c7bdf-ef47-455d-9635-a449dd2e56fa" released by "delete_volume" :: held 1.083s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Created reservations ['11dc5737-9334-4ccb-982c-ee2a37928bc6', '6f849383-2c3b-4255-bcec-fec123ef0f2b', '0465860d-2312-4c4e-b319-df87824beecc', '14d8f3e4-7810-4ef1-ba75-c794f8594f84'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:02 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:40:02 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:02 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.466s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:02 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Deleted volume successfully. Apr 10 10:40:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ec83705e-9d4c-4a79-8db9-cfd5bc35971b tempest-VolumesActionsTest-413421 None] Lock "cinder-650c7bdf-ef47-455d-9635-a449dd2e56fa-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (dbe82b15-b7a0-4c61-9074-6101fe5b143e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff06fa22-3bce-4626-b553-23089491f47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff06fa22-3bce-4626-b553-23089491f47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1603068290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051a4957-2669-4e0c-b5ad-e8c642f48789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:04Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5acdbcc-aa91-4914-af20-6ae86ceca756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5acdbcc-aa91-4914-af20-6ae86ceca756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5463fe16-b264-4b83-b82b-b7e8a51eec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5463fe16-b264-4b83-b82b-b7e8a51eec51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051a4957-2669-4e0c-b5ad-e8c642f48789', 'volume_name': 'volume-051a4957-2669-4e0c-b5ad-e8c642f48789', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30309f31-f120-44a8-812f-3c211f8b44c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30309f31-f120-44a8-812f-3c211f8b44c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63370642-6005-400b-8520-43bf9a49243c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:03 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Volume 051a4957-2669-4e0c-b5ad-e8c642f48789: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051a4957-2669-4e0c-b5ad-e8c642f48789', 'volume_size': 1} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1603068290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051a4957-2669-4e0c-b5ad-e8c642f48789,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:04Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Creating volume 051a4957-2669-4e0c-b5ad-e8c642f48789 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:03 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:40:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:03 devstack sudo[88155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789 1073741824 Apr 10 10:40:03 devstack sudo[88155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:04 devstack sudo[88155]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789 1073741824" returned: 0 in 0.618s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:04 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789 Apr 10 10:40:04 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:04 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789" returned: 0 in 0.452s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63370642-6005-400b-8520-43bf9a49243c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051a4957-2669-4e0c-b5ad-e8c642f48789', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95885212-5054-43a1-854e-5745fc334e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:04 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Volume volume-051a4957-2669-4e0c-b5ad-e8c642f48789 (051a4957-2669-4e0c-b5ad-e8c642f48789): created successfully Apr 10 10:40:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95885212-5054-43a1-854e-5745fc334e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (dbe82b15-b7a0-4c61-9074-6101fe5b143e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:04 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-8a22bf6f-d3d0-4cde-b781-eae3d94b52fb tempest-VolumesActionsTest-1696777940 None] Created volume successfully. Apr 10 10:40:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Acquiring lock "cinder-051a4957-2669-4e0c-b5ad-e8c642f48789-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Lock "cinder-051a4957-2669-4e0c-b5ad-e8c642f48789-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Acquiring lock "cinder-quobyte-051a4957-2669-4e0c-b5ad-e8c642f48789" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Lock "cinder-quobyte-051a4957-2669-4e0c-b5ad-e8c642f48789" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:05 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af750f4-11c9-4410-909c-78084cae6642]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:06 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789 Apr 10 10:40:06 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:06 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789" returned: 0 in 0.655s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:06 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789 Apr 10 10:40:06 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Flow 'volume_create_manager' (6f9e068c-86cc-4b86-8d9f-df4e75ec4f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41b7aa1-1720-4e8d-bb01-5b40fcb869cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41b7aa1-1720-4e8d-bb01-5b40fcb869cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463108329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83feba7c48ef4c48b32d224d45464592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:07Z,use_quota=True,user_id='ae51e7a39af4423a83dc3995fbdb14bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddb2862-0e12-4ad6-a8ca-5e2cbe589541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ddb2862-0e12-4ad6-a8ca-5e2cbe589541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf34fff-9fd0-4f8f-bf24-dd1cd0a54d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf34fff-9fd0-4f8f-bf24-dd1cd0a54d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1', 'volume_name': 'volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1faa385-505b-412a-9087-c36859b7ba41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1faa385-505b-412a-9087-c36859b7ba41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5fd6b2-ec2a-40bc-8494-4478701db283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:06 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Volume 4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1', 'volume_size': 1} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463108329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='83feba7c48ef4c48b32d224d45464592',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:07Z,use_quota=True,user_id='ae51e7a39af4423a83dc3995fbdb14bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Creating volume 4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:06 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:40:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:07 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 1073741824 Apr 10 10:40:07 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:07 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-051a4957-2669-4e0c-b5ad-e8c642f48789" returned: 0 in 0.491s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Lock "cinder-quobyte-051a4957-2669-4e0c-b5ad-e8c642f48789" released by "delete_volume" :: held 1.177s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Created reservations ['f277cbff-6587-4db8-89ce-f2c7adafe932', '5542c342-3ff4-4bed-acd4-ab3ef3bddbe8', '34738f37-fafc-44d8-a400-0416ee2f062d', 'f1449612-eb19-4039-9e47-237a77432836'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:07 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:40:07 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:07 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 1073741824" returned: 0 in 0.512s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:07 devstack sudo[88179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 Apr 10 10:40:07 devstack sudo[88179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:07 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.471s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:07 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Deleted volume successfully. Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-98cc6dee-4148-4331-8baf-81d3c6d9c790 tempest-VolumesActionsTest-413421 None] Lock "cinder-051a4957-2669-4e0c-b5ad-e8c642f48789-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:07 devstack sudo[88179]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" returned: 0 in 0.445s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f5fd6b2-ec2a-40bc-8494-4478701db283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b210859a-fb92-493a-ba3a-180de926d0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:08 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Volume volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 (4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1): created successfully Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b210859a-fb92-493a-ba3a-180de926d0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Flow 'volume_create_manager' (6f9e068c-86cc-4b86-8d9f-df4e75ec4f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:08 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ca6e99cb-6a4f-43f5-bcf1-3a7bf697ee9b tempest-VolumesActionsTest-1354903456 None] Created volume successfully. Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (dc6c1585-dfa7-4ffa-846b-5a1460a540b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb9d70b-bd36-4735-80e3-ddef2d9b14c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eb9d70b-bd36-4735-80e3-ddef2d9b14c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-527972860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40872913-a9d8-47ba-8668-e5ad179e566a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:08Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c2b3ac-c7f0-4213-b2c2-1b4106703da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6c2b3ac-c7f0-4213-b2c2-1b4106703da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1710c0c-bfa6-4689-b9e6-6fe1777011f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1710c0c-bfa6-4689-b9e6-6fe1777011f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40872913-a9d8-47ba-8668-e5ad179e566a', 'volume_name': 'volume-40872913-a9d8-47ba-8668-e5ad179e566a', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9b4f71-023d-4126-99b1-68e4a9795869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9b4f71-023d-4126-99b1-68e4a9795869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe0bc88-7829-4963-98a3-7d11890942cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:08 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Volume 40872913-a9d8-47ba-8668-e5ad179e566a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40872913-a9d8-47ba-8668-e5ad179e566a', 'volume_size': 1} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-527972860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40872913-a9d8-47ba-8668-e5ad179e566a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:08Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Creating volume 40872913-a9d8-47ba-8668-e5ad179e566a {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:08 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:08 devstack sudo[88183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a 1073741824 Apr 10 10:40:08 devstack sudo[88183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:08 devstack sudo[88183]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a 1073741824" returned: 0 in 0.516s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:09 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a Apr 10 10:40:09 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:09 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a" returned: 0 in 0.469s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe0bc88-7829-4963-98a3-7d11890942cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40872913-a9d8-47ba-8668-e5ad179e566a', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f46a0a3-0cbc-47dd-a88e-8be90798ee75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:09 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Volume volume-40872913-a9d8-47ba-8668-e5ad179e566a (40872913-a9d8-47ba-8668-e5ad179e566a): created successfully Apr 10 10:40:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f46a0a3-0cbc-47dd-a88e-8be90798ee75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (dc6c1585-dfa7-4ffa-846b-5a1460a540b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:09 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c5fe30e4-a0d2-4a00-b85c-eb2fe6249233 tempest-VolumesActionsTest-1696777940 None] Created volume successfully. Apr 10 10:40:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Acquiring lock "cinder-40872913-a9d8-47ba-8668-e5ad179e566a-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Lock "cinder-40872913-a9d8-47ba-8668-e5ad179e566a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Acquiring lock "cinder-quobyte-40872913-a9d8-47ba-8668-e5ad179e566a" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Lock "cinder-quobyte-40872913-a9d8-47ba-8668-e5ad179e566a" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:10 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9712e92-e0de-415e-8867-8b4090288a88]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:10 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a Apr 10 10:40:10 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:11 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a" returned: 0 in 0.520s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:11 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a Apr 10 10:40:11 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:11 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-40872913-a9d8-47ba-8668-e5ad179e566a" returned: 0 in 0.435s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Lock "cinder-quobyte-40872913-a9d8-47ba-8668-e5ad179e566a" released by "delete_volume" :: held 0.977s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Created reservations ['c02d7e5c-a246-40d9-92c6-921287f1cf9e', '79dc5f73-0f32-45b5-a0fc-fe53b891c983', 'ad62cf48-92bf-4c84-ab71-2c95dd09785a', 'f0f60da5-898b-4495-8af1-c64dbc322697'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:11 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:40:11 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:12 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.419s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:12 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:12 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Deleted volume successfully. Apr 10 10:40:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-597297cb-4567-47ef-a5a3-2f9c92c89b5e tempest-VolumesActionsTest-413421 None] Lock "cinder-40872913-a9d8-47ba-8668-e5ad179e566a-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (85b2bac5-f60f-4bc3-ad61-8506b4203c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74d3a48-e9d1-4919-879c-1b5d114f17fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b74d3a48-e9d1-4919-879c-1b5d114f17fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-567564682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d9b94c-0110-4220-8550-e2afd730b678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:13Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894a463d-e3e1-4a27-8669-fc00fa64e33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894a463d-e3e1-4a27-8669-fc00fa64e33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24367b69-e7d1-42e4-8652-58085ed3873b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24367b69-e7d1-42e4-8652-58085ed3873b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d9b94c-0110-4220-8550-e2afd730b678', 'volume_name': 'volume-30d9b94c-0110-4220-8550-e2afd730b678', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c4c81d-4b36-4791-87a0-6bec74851bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01c4c81d-4b36-4791-87a0-6bec74851bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322cb07e-b818-43af-b711-04a3d7627d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:13 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Volume 30d9b94c-0110-4220-8550-e2afd730b678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d9b94c-0110-4220-8550-e2afd730b678', 'volume_size': 1} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-567564682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d9b94c-0110-4220-8550-e2afd730b678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:13Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Creating volume 30d9b94c-0110-4220-8550-e2afd730b678 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:13 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:13 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678 1073741824 Apr 10 10:40:13 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:13 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678 1073741824" returned: 0 in 0.508s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:13 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678 Apr 10 10:40:13 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:14 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678" returned: 0 in 0.481s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (322cb07e-b818-43af-b711-04a3d7627d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d9b94c-0110-4220-8550-e2afd730b678', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69472295-007c-48ba-84bd-46c0b5f7c525) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:14 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Volume volume-30d9b94c-0110-4220-8550-e2afd730b678 (30d9b94c-0110-4220-8550-e2afd730b678): created successfully Apr 10 10:40:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69472295-007c-48ba-84bd-46c0b5f7c525) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (85b2bac5-f60f-4bc3-ad61-8506b4203c30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:14 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-10685240-1319-4390-ac20-846dc2ad21bb tempest-VolumesActionsTest-1696777940 None] Created volume successfully. Apr 10 10:40:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Acquiring lock "cinder-30d9b94c-0110-4220-8550-e2afd730b678-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Lock "cinder-30d9b94c-0110-4220-8550-e2afd730b678-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Acquiring lock "cinder-quobyte-30d9b94c-0110-4220-8550-e2afd730b678" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Lock "cinder-quobyte-30d9b94c-0110-4220-8550-e2afd730b678" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:15 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c50c9ab-8907-45c2-8b17-22448d3e4124]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:15 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678 Apr 10 10:40:15 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:16 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678" returned: 0 in 0.526s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:16 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678 Apr 10 10:40:16 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:16 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-30d9b94c-0110-4220-8550-e2afd730b678" returned: 0 in 0.499s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Lock "cinder-quobyte-30d9b94c-0110-4220-8550-e2afd730b678" released by "delete_volume" :: held 1.053s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Created reservations ['39ab887d-d367-44d3-ac08-df9afa0e7663', '5de5614f-ca93-4f2f-bb58-629ef9403eea', 'a79029b2-be79-4033-9cd0-04b5d6bdf3b7', '8cc9222b-858b-47fd-a1cc-7b86419a5c6a'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:16 devstack sudo[88235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:40:16 devstack sudo[88235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:17 devstack sudo[88235]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.459s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:17 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:17 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Deleted volume successfully. Apr 10 10:40:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6c0ed237-195a-4d45-8838-55687ffd6617 tempest-VolumesActionsTest-413421 None] Lock "cinder-30d9b94c-0110-4220-8550-e2afd730b678-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:17 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (fbfee33e-39c5-4c7e-add5-11197cc6ffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acfa0e8-e031-4af6-8800-192dad98fd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0acfa0e8-e031-4af6-8800-192dad98fd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1224372173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece16785-eda1-4e7e-9f93-664db169cc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:18Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833bacf0-3611-4500-afb9-2a0b5fe98f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (833bacf0-3611-4500-afb9-2a0b5fe98f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760c701a-2e30-472e-9f02-0fa1f8ccba0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (760c701a-2e30-472e-9f02-0fa1f8ccba0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ece16785-eda1-4e7e-9f93-664db169cc64', 'volume_name': 'volume-ece16785-eda1-4e7e-9f93-664db169cc64', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c89c657-f9a4-448a-86c5-b9bd156d6ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c89c657-f9a4-448a-86c5-b9bd156d6ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2148f035-64a4-435d-b274-08e6b8f40bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:18 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Volume ece16785-eda1-4e7e-9f93-664db169cc64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ece16785-eda1-4e7e-9f93-664db169cc64', 'volume_size': 1} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1224372173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ece16785-eda1-4e7e-9f93-664db169cc64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6341df624ba94938be423632eda9999a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:18Z,use_quota=True,user_id='74775fdae8fd45499d86f6dcc1254d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Creating volume ece16785-eda1-4e7e-9f93-664db169cc64 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:18 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:18 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64 1073741824 Apr 10 10:40:18 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:18 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64 1073741824" returned: 0 in 0.522s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:18 devstack sudo[88243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64 Apr 10 10:40:18 devstack sudo[88243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:19 devstack sudo[88243]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64" returned: 0 in 0.479s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2148f035-64a4-435d-b274-08e6b8f40bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ece16785-eda1-4e7e-9f93-664db169cc64', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02d8621-851c-410f-a8a7-5db17b53a27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:19 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Volume volume-ece16785-eda1-4e7e-9f93-664db169cc64 (ece16785-eda1-4e7e-9f93-664db169cc64): created successfully Apr 10 10:40:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d02d8621-851c-410f-a8a7-5db17b53a27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Flow 'volume_create_manager' (fbfee33e-39c5-4c7e-add5-11197cc6ffbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:19 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-8b053fa9-d9f8-4974-b7ca-ad717c479307 tempest-VolumesActionsTest-1696777940 None] Created volume successfully. Apr 10 10:40:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "cinder-ece16785-eda1-4e7e-9f93-664db169cc64-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-ece16785-eda1-4e7e-9f93-664db169cc64-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "cinder-quobyte-ece16785-eda1-4e7e-9f93-664db169cc64" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-quobyte-ece16785-eda1-4e7e-9f93-664db169cc64" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:20 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e26c5d-cc9b-436f-8db9-127ac9325b7f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:21 devstack sudo[88275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64 Apr 10 10:40:21 devstack sudo[88275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:21 devstack sudo[88275]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64" returned: 0 in 0.652s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:21 devstack sudo[88280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64 Apr 10 10:40:21 devstack sudo[88280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:22 devstack sudo[88280]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ece16785-eda1-4e7e-9f93-664db169cc64" returned: 0 in 0.520s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-quobyte-ece16785-eda1-4e7e-9f93-664db169cc64" released by "delete_volume" :: held 1.234s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Created reservations ['7e3a6b1d-b399-4e49-a34e-81bebda22bcf', '06e5206a-19f6-45fb-a757-54da25bc7ba5', '13cc25ba-f276-46f6-b2cf-9dfc0c642952', '101009c4-17a9-44cd-9ddd-9671095d34a3'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:22 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:40:22 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4366b94e-773c-4c8c-8e19-643f266d0f71 tempest-VolumesActionsTest-1354903456 None] Acquiring lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" by "attach_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4366b94e-773c-4c8c-8e19-643f266d0f71 tempest-VolumesActionsTest-1354903456 None] Lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" acquired by "attach_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:22 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4366b94e-773c-4c8c-8e19-643f266d0f71 tempest-VolumesActionsTest-1354903456 None] Attaching volume 4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 to instance c3548aba-4246-4b38-90c4-b971a16db079 at mountpoint /dev/vdb on host None. Apr 10 10:40:22 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.569s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:22 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Deleted volume successfully. Apr 10 10:40:22 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4366b94e-773c-4c8c-8e19-643f266d0f71 tempest-VolumesActionsTest-1354903456 None] Attach volume completed successfully. Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4366b94e-773c-4c8c-8e19-643f266d0f71 tempest-VolumesActionsTest-1354903456 None] Lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" released by "attach_volume" :: held 0.102s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:22 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ef6f1300-5c96-4d85-b8c1-1ab4f4239ef2 tempest-VolumesActionsTest-1696777940 None] Lock "cinder-ece16785-eda1-4e7e-9f93-664db169cc64-delete_volume" released by "delete_volume" :: held 2.057s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f546d510-b9b1-4a91-a49b-40bc0fc5619b tempest-VolumesActionsTest-1354903456 None] Acquiring lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1-detach_volume" by "detach_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f546d510-b9b1-4a91-a49b-40bc0fc5619b tempest-VolumesActionsTest-1354903456 None] Lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:23 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f546d510-b9b1-4a91-a49b-40bc0fc5619b tempest-VolumesActionsTest-1354903456 None] Detaching volume 4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 from instance c3548aba-4246-4b38-90c4-b971a16db079. Apr 10 10:40:23 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f546d510-b9b1-4a91-a49b-40bc0fc5619b tempest-VolumesActionsTest-1354903456 None] Detach volume completed successfully. Apr 10 10:40:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f546d510-b9b1-4a91-a49b-40bc0fc5619b tempest-VolumesActionsTest-1354903456 None] Lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1-detach_volume" released by "detach_volume" :: held 0.049s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:33 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=88,cinder:INSERT=36,cinder:UPDATE=122,cinder:DELETE=9 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:40:33 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=82,cinder:INSERT=21,cinder:UPDATE=120,cinder:DELETE=11 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Flow 'volume_create_manager' (cf7b2cfe-d2f3-4e95-b5f2-1c44cba6b7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384f0c24-940c-442f-a1c5-2509800ecfa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (384f0c24-940c-442f-a1c5-2509800ecfa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-724381029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719762eb-686b-4315-a7bc-596b6459c6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd1b12d80964023aa3498ef7afaa540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:34Z,use_quota=True,user_id='14b22b09853f4d7ca96e634cc23e1070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f377d8-ec48-4080-a9fd-ccbbb8368d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f377d8-ec48-4080-a9fd-ccbbb8368d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c8f7e7-0552-4117-9d3e-79cf02a631c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30c8f7e7-0552-4117-9d3e-79cf02a631c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '719762eb-686b-4315-a7bc-596b6459c6f7', 'volume_name': 'volume-719762eb-686b-4315-a7bc-596b6459c6f7', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137e44fe-b730-4318-8482-03bdae355a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137e44fe-b730-4318-8482-03bdae355a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f13f29-3fbd-4b28-ba33-205833e163e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:34 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Volume 719762eb-686b-4315-a7bc-596b6459c6f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-719762eb-686b-4315-a7bc-596b6459c6f7', 'volume_size': 1} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-724381029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=719762eb-686b-4315-a7bc-596b6459c6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd1b12d80964023aa3498ef7afaa540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:34Z,use_quota=True,user_id='14b22b09853f4d7ca96e634cc23e1070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Creating volume 719762eb-686b-4315-a7bc-596b6459c6f7 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:34 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:40:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:34 devstack sudo[88319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7 1073741824 Apr 10 10:40:34 devstack sudo[88319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:35 devstack sudo[88319]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7 1073741824" returned: 0 in 0.588s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:35 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7 Apr 10 10:40:35 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:35 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7" returned: 0 in 0.517s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f13f29-3fbd-4b28-ba33-205833e163e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-719762eb-686b-4315-a7bc-596b6459c6f7', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc1b3ec-49eb-4927-aba1-d1a41f73ae0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:35 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Volume volume-719762eb-686b-4315-a7bc-596b6459c6f7 (719762eb-686b-4315-a7bc-596b6459c6f7): created successfully Apr 10 10:40:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc1b3ec-49eb-4927-aba1-d1a41f73ae0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Flow 'volume_create_manager' (cf7b2cfe-d2f3-4e95-b5f2-1c44cba6b7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:35 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e4899191-7eb8-4e08-a1ba-c0aa22c2c3d5 tempest-VolumesTransfersV355Test-1865653632 None] Created volume successfully. Apr 10 10:40:37 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b0d762ae-d232-45aa-b4ee-d4dbe43e5c7c tempest-VolumesTransfersV355Test-541647374 None] Transfer volume completed successfully. Apr 10 10:40:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Acquiring lock "cinder-719762eb-686b-4315-a7bc-596b6459c6f7-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Lock "cinder-719762eb-686b-4315-a7bc-596b6459c6f7-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Acquiring lock "cinder-quobyte-719762eb-686b-4315-a7bc-596b6459c6f7" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Lock "cinder-quobyte-719762eb-686b-4315-a7bc-596b6459c6f7" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:37 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fe599e-7e1e-4d96-b4fa-8122730cbb20]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:38 devstack sudo[88343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7 Apr 10 10:40:38 devstack sudo[88343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:38 devstack sudo[88343]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7" returned: 0 in 0.514s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:38 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7 Apr 10 10:40:38 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:38 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-719762eb-686b-4315-a7bc-596b6459c6f7" returned: 0 in 0.439s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Lock "cinder-quobyte-719762eb-686b-4315-a7bc-596b6459c6f7" released by "delete_volume" :: held 1.002s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Created reservations ['d8d6853d-112a-4ca1-91fb-e1a08953a797', '121f12cd-1b1c-46f5-879a-8a0a9ff6dd86', '0679dac7-0fd9-4052-aed0-4ab153a605a1', '9b6564ab-fa37-4091-be3f-aa4252affbe4'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:38 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:40:38 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:39 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:40:39 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:39 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.502s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:39 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Deleted volume successfully. Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-20b0e8e4-7a50-476b-aa9c-c42b1ec6a332 tempest-VolumesTransfersV355Test-905711236 None] Lock "cinder-719762eb-686b-4315-a7bc-596b6459c6f7-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:39 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.480s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:39 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Flow 'volume_create_manager' (1d6c750b-ca61-4244-a557-3d37e317087a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9953f72-064f-40e8-8580-f683c01b78f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9953f72-064f-40e8-8580-f683c01b78f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1290410650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568e0f31-6c08-4635-b51f-e69031e26238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd1b12d80964023aa3498ef7afaa540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:40Z,use_quota=True,user_id='14b22b09853f4d7ca96e634cc23e1070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d326ff-05c7-4af1-938b-bf5228cf67b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d326ff-05c7-4af1-938b-bf5228cf67b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ddefc5-f539-46d5-a95a-3dbdddb8bac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03ddefc5-f539-46d5-a95a-3dbdddb8bac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '568e0f31-6c08-4635-b51f-e69031e26238', 'volume_name': 'volume-568e0f31-6c08-4635-b51f-e69031e26238', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320c3817-f14b-4c88-9bdf-1e8acce5d07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (320c3817-f14b-4c88-9bdf-1e8acce5d07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ee973d-fe6a-4049-8f17-1966a45e1419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:40 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Volume 568e0f31-6c08-4635-b51f-e69031e26238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-568e0f31-6c08-4635-b51f-e69031e26238', 'volume_size': 1} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1290410650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=568e0f31-6c08-4635-b51f-e69031e26238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd1b12d80964023aa3498ef7afaa540',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:40Z,use_quota=True,user_id='14b22b09853f4d7ca96e634cc23e1070',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Creating volume 568e0f31-6c08-4635-b51f-e69031e26238 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:40 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:40 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238 1073741824 Apr 10 10:40:40 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:40 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238 1073741824" returned: 0 in 0.544s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:41 devstack sudo[88365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238 Apr 10 10:40:41 devstack sudo[88365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:41 devstack sudo[88365]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238" returned: 0 in 0.419s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66ee973d-fe6a-4049-8f17-1966a45e1419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-568e0f31-6c08-4635-b51f-e69031e26238', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9cbdcf-af99-4423-9c80-dad82011d54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:41 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Volume volume-568e0f31-6c08-4635-b51f-e69031e26238 (568e0f31-6c08-4635-b51f-e69031e26238): created successfully Apr 10 10:40:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9cbdcf-af99-4423-9c80-dad82011d54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Flow 'volume_create_manager' (1d6c750b-ca61-4244-a557-3d37e317087a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:41 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0ce53d70-67a0-48a0-85e4-dcc159c821ab tempest-VolumesTransfersV355Test-1865653632 None] Created volume successfully. Apr 10 10:40:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Acquiring lock "cinder-568e0f31-6c08-4635-b51f-e69031e26238-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Lock "cinder-568e0f31-6c08-4635-b51f-e69031e26238-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Acquiring lock "cinder-quobyte-568e0f31-6c08-4635-b51f-e69031e26238" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Lock "cinder-quobyte-568e0f31-6c08-4635-b51f-e69031e26238" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:42 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d6d2cb-50db-4fb4-8549-5e00f34d44de]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:42 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238 Apr 10 10:40:42 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:43 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238" returned: 0 in 0.502s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:43 devstack sudo[88400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238 Apr 10 10:40:43 devstack sudo[88400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:43 devstack sudo[88400]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-568e0f31-6c08-4635-b51f-e69031e26238" returned: 0 in 0.437s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Lock "cinder-quobyte-568e0f31-6c08-4635-b51f-e69031e26238" released by "delete_volume" :: held 0.981s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Created reservations ['e41f3ebd-7c61-4b6e-b913-36dd73f27090', '25e00707-2084-413c-b40c-e40b649e31c3', '1c279a7f-8948-4c3a-9bec-f0c7697691b3', 'ebba903f-49d4-4d9a-82e6-5b8dc1772ae1'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:43 devstack sudo[88403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:40:43 devstack sudo[88403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c3edadc5-91ec-4d30-86d2-07c1174b5943 tempest-VolumesActionsTest-1354903456 None] Acquiring lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" by "attach_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c3edadc5-91ec-4d30-86d2-07c1174b5943 tempest-VolumesActionsTest-1354903456 None] Lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" acquired by "attach_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c3edadc5-91ec-4d30-86d2-07c1174b5943 tempest-VolumesActionsTest-1354903456 None] Attaching volume 4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 to instance 73bd4510-7cff-4e37-bd5b-2f148c35ddad at mountpoint /dev/vdb on host None. Apr 10 10:40:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c3edadc5-91ec-4d30-86d2-07c1174b5943 tempest-VolumesActionsTest-1354903456 None] Attach volume completed successfully. Apr 10 10:40:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c3edadc5-91ec-4d30-86d2-07c1174b5943 tempest-VolumesActionsTest-1354903456 None] Lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" released by "attach_volume" :: held 0.072s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:44 devstack sudo[88403]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.641s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:44 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Deleted volume successfully. Apr 10 10:40:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-eb266fc9-62ca-4b49-9ea6-0d2bc9804a25 tempest-VolumesTransfersV355Test-905711236 None] Lock "cinder-568e0f31-6c08-4635-b51f-e69031e26238-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-47a1a7cd-5165-4671-8668-2341cc6c1359 tempest-VolumesActionsTest-1354903456 None] Acquiring lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1-detach_volume" by "detach_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-47a1a7cd-5165-4671-8668-2341cc6c1359 tempest-VolumesActionsTest-1354903456 None] Lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-47a1a7cd-5165-4671-8668-2341cc6c1359 tempest-VolumesActionsTest-1354903456 None] Detaching volume 4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 from instance 73bd4510-7cff-4e37-bd5b-2f148c35ddad. Apr 10 10:40:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-47a1a7cd-5165-4671-8668-2341cc6c1359 tempest-VolumesActionsTest-1354903456 None] Detach volume completed successfully. Apr 10 10:40:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-47a1a7cd-5165-4671-8668-2341cc6c1359 tempest-VolumesActionsTest-1354903456 None] Lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1-detach_volume" released by "detach_volume" :: held 0.048s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:47 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (49728bd8-89ee-4dbb-b1c0-e9dfe8ec0b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15a014a-f9eb-462b-8f56-b60832f94364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15a014a-f9eb-462b-8f56-b60832f94364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-30456949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a2d6f6-28f5-4519-909d-e337586070f7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:48Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef70c72-b0e0-466b-a79f-3a6ff88e04f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef70c72-b0e0-466b-a79f-3a6ff88e04f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506ea0e2-4c05-40e3-a74c-4b63b8670b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (506ea0e2-4c05-40e3-a74c-4b63b8670b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a2d6f6-28f5-4519-909d-e337586070f7', 'volume_name': 'volume-01a2d6f6-28f5-4519-909d-e337586070f7', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab93e38a-911b-4275-9338-262708516184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab93e38a-911b-4275-9338-262708516184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c3a070-dca9-4296-b618-32705eb35ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:48 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Volume 01a2d6f6-28f5-4519-909d-e337586070f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a2d6f6-28f5-4519-909d-e337586070f7', 'volume_size': 1} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-30456949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a2d6f6-28f5-4519-909d-e337586070f7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:48Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Creating volume 01a2d6f6-28f5-4519-909d-e337586070f7 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:48 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:48 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7 1073741824 Apr 10 10:40:48 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:48 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7 1073741824" returned: 0 in 0.696s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:48 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7 Apr 10 10:40:48 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:49 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7" returned: 0 in 0.433s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c3a070-dca9-4296-b618-32705eb35ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a2d6f6-28f5-4519-909d-e337586070f7', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f9eab7-1ec3-46ea-9e19-70b4ca8eb192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:49 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Volume volume-01a2d6f6-28f5-4519-909d-e337586070f7 (01a2d6f6-28f5-4519-909d-e337586070f7): created successfully Apr 10 10:40:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39f9eab7-1ec3-46ea-9e19-70b4ca8eb192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (49728bd8-89ee-4dbb-b1c0-e9dfe8ec0b2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:49 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a731032b-3dd0-43f3-af23-6e2949cde4f7 tempest-VolumesGetTest-705748558 None] Created volume successfully. Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (b4700e0e-265a-49f5-bdb2-c9c27112ee10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8d7288-dcb3-46ff-af06-b916973ddd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f8d7288-dcb3-46ff-af06-b916973ddd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-440850631',display_name='tempest-VolumesGetTest-Volume-2147429569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b20730-dfb9-4b99-acfd-356087a6e1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:51Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22304630-81fd-4bb9-a4be-bb5c381c13e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22304630-81fd-4bb9-a4be-bb5c381c13e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf0d622-a28a-4b62-a29d-2edfd634f475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cf0d622-a28a-4b62-a29d-2edfd634f475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59b20730-dfb9-4b99-acfd-356087a6e1fb', 'volume_name': 'volume-59b20730-dfb9-4b99-acfd-356087a6e1fb', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae26dc44-1fd9-48bd-a2af-b803dedac868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae26dc44-1fd9-48bd-a2af-b803dedac868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8814eb13-248c-4c38-92da-4dff20c082ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:50 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Volume 59b20730-dfb9-4b99-acfd-356087a6e1fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59b20730-dfb9-4b99-acfd-356087a6e1fb', 'volume_size': 1} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-440850631',display_name='tempest-VolumesGetTest-Volume-2147429569',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59b20730-dfb9-4b99-acfd-356087a6e1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:51Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Creating volume 59b20730-dfb9-4b99-acfd-356087a6e1fb {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:40:50 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:40:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:50 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb 1073741824 Apr 10 10:40:50 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:51 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb 1073741824" returned: 0 in 0.607s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:51 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb Apr 10 10:40:51 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:51 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb" returned: 0 in 0.559s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:40:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8814eb13-248c-4c38-92da-4dff20c082ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59b20730-dfb9-4b99-acfd-356087a6e1fb', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61be266-ef93-4ce4-8371-437ddb61d3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:51 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Volume volume-59b20730-dfb9-4b99-acfd-356087a6e1fb (59b20730-dfb9-4b99-acfd-356087a6e1fb): created successfully Apr 10 10:40:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61be266-ef93-4ce4-8371-437ddb61d3d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (b4700e0e-265a-49f5-bdb2-c9c27112ee10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:51 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-67130603-92a2-4100-a9b4-f39ca354b1b5 tempest-VolumesGetTest-705748558 None] Created volume successfully. Apr 10 10:40:52 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-59b20730-dfb9-4b99-acfd-356087a6e1fb-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:52 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Lock "cinder-59b20730-dfb9-4b99-acfd-356087a6e1fb-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:52 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-quobyte-59b20730-dfb9-4b99-acfd-356087a6e1fb" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-59b20730-dfb9-4b99-acfd-356087a6e1fb" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a4ac51-d566-4e06-8558-4bcf89e25d97]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:53 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb Apr 10 10:40:53 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:53 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb" returned: 0 in 0.578s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:53 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb Apr 10 10:40:53 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:54 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59b20730-dfb9-4b99-acfd-356087a6e1fb" returned: 0 in 0.451s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-59b20730-dfb9-4b99-acfd-356087a6e1fb" released by "delete_volume" :: held 1.085s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e72ae6b-22b9-413d-bb24-901f9fa94533]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Created reservations ['98709154-e48d-48f4-bd17-fa51c91c7852', '1f563c6e-8345-422a-ad13-96abb0aa4387', '319c85fd-394e-495b-9ddb-66d137f6a8cc', '3733f9b9-58e6-4fcf-be5a-d4113e92c255'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:54 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 Apr 10 10:40:54 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:54 devstack sudo[88466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:40:54 devstack sudo[88466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:54 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" returned: 0 in 0.496s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6653f9eb-f0f8-4cfe-8794-a55b394111ea]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:54 devstack sudo[88466]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.418s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:54 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Deleted volume successfully. Apr 10 10:40:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a1372912-33fb-4021-b895-cf51134a578d tempest-VolumesGetTest-705748558 None] Lock "cinder-59b20730-dfb9-4b99-acfd-356087a6e1fb-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:54 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 Apr 10 10:40:54 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:55 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" returned: 0 in 0.505s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.b5cf13d1-7549-4cb5-9dce-ed35ee38ded9fihy7pmb.img {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:55 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.b5cf13d1-7549-4cb5-9dce-ed35ee38ded9fihy7pmb.img Apr 10 10:40:55 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-01a2d6f6-28f5-4519-909d-e337586070f7-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Lock "cinder-01a2d6f6-28f5-4519-909d-e337586070f7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-quobyte-01a2d6f6-28f5-4519-909d-e337586070f7" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:40:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-01a2d6f6-28f5-4519-909d-e337586070f7" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:40:55 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8a600e-d3ae-44dd-b0f7-22c7db2ceff9]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:55 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7 Apr 10 10:40:55 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:56 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7" returned: 0 in 1.136s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:56 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7 Apr 10 10:40:56 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:57 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.b5cf13d1-7549-4cb5-9dce-ed35ee38ded9fihy7pmb.img" returned: 0 in 1.967s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9572c976-9d83-4393-8321-8ccb733338a7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:57 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 Apr 10 10:40:57 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:57 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-01a2d6f6-28f5-4519-909d-e337586070f7" returned: 0 in 0.879s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-01a2d6f6-28f5-4519-909d-e337586070f7" released by "delete_volume" :: held 2.048s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Created reservations ['8e70f36d-de55-4368-b891-9f2a179a0fba', 'fc11f815-ca03-40c6-9f35-83e1fb999a0a', '5550a65f-89b7-4a45-99ad-62b1611af77b', '8807f86e-bb04-48ec-b2b4-75d8e8153789'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:40:57 devstack sudo[88499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:40:57 devstack sudo[88499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:40:57 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" returned: 0 in 0.661s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1, size 1024.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.b5cf13d1-7549-4cb5-9dce-ed35ee38ded9fihy7pmb.img {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:40:57 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Converted 1024.00 MB image at 520.35 MB/s Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] b5cf13d1-7549-4cb5-9dce-ed35ee38ded9 was raw, no need to convert to raw {{(pid=82038) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (029e0306-996b-4ac7-8fc0-6cfee03e50d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5ce144-45a9-408f-b1e1-0653ae972abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5ce144-45a9-408f-b1e1-0653ae972abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1969533914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e8ec13-5114-4633-ac9e-f1b790529dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:58Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c638479-8e9d-4b4a-ac37-9e9059a30142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c638479-8e9d-4b4a-ac37-9e9059a30142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064d5971-a3d1-409e-92df-808f712f3505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (064d5971-a3d1-409e-92df-808f712f3505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5e8ec13-5114-4633-ac9e-f1b790529dd0', 'volume_name': 'volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa2d1e3-3f94-4140-b2cd-17bd73173ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fa2d1e3-3f94-4140-b2cd-17bd73173ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a326a4-f1f5-4cb8-b0c6-cfa86b1b8ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:40:57 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Volume d5e8ec13-5114-4633-ac9e-f1b790529dd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0', 'volume_size': 1} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:40:57 devstack sudo[88499]: pam_unix(sudo:session): session closed for user root Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.525s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:40:57 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Deleted volume successfully. Apr 10 10:40:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1f818f89-ec66-4a07-ae73-7caba4a857f7 tempest-VolumesGetTest-705748558 None] Lock "cinder-01a2d6f6-28f5-4519-909d-e337586070f7-delete_volume" released by "delete_volume" :: held 2.732s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:07 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=40,cinder:INSERT=12,cinder:UPDATE=51,cinder:DELETE=4 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:41:07 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:UPDATE=44,cinder:SELECT=35,cinder:DELETE=4,cinder:INSERT=10 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.322s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Uploaded volume to glance image-id: b5cf13d1-7549-4cb5-9dce-ed35ee38ded9. {{(pid=82038) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.526s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:40:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1969533914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5e8ec13-5114-4633-ac9e-f1b790529dd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:40:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:40:58Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Creating volume d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:08 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:08 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 1073741824 Apr 10 10:41:08 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:08 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-9366e1ba-f7a1-41e5-8c76-493afdbe2e8f tempest-VolumesActionsTest-1354903456 None] Copy volume to image completed successfully. Apr 10 10:41:08 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 1073741824" returned: 0 in 0.550s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:09 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 Apr 10 10:41:09 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:09 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0" returned: 0 in 0.450s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.323s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a326a4-f1f5-4cb8-b0c6-cfa86b1b8ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d49054-f161-45f2-b759-cfbaa371728d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5deaf5-712b-4b42-824b-7b60c21e34f5]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:09 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Volume volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 (d5e8ec13-5114-4633-ac9e-f1b790529dd0): created successfully Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d49054-f161-45f2-b759-cfbaa371728d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (029e0306-996b-4ac7-8fc0-6cfee03e50d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:09 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e325b51c-ca31-48ab-b528-289365865618 tempest-VolumesGetTest-705748558 None] Created volume successfully. Apr 10 10:41:09 devstack sudo[88551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 Apr 10 10:41:09 devstack sudo[88551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:09 devstack sudo[88551]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" returned: 0 in 0.499s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1281a3-17b7-4896-9bf9-aabdee452d49]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:10 devstack sudo[88556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 Apr 10 10:41:10 devstack sudo[88556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:10 devstack sudo[88556]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" returned: 0 in 0.495s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:10 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img Apr 10 10:41:10 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:10 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (534efc9d-2c4b-4647-b020-fafccb150bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23c6205-ce76-40c4-9994-e92702424987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f23c6205-ce76-40c4-9994-e92702424987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1261975827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba44f189-8e4d-4e56-b929-1b0f252e4a34,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=d5e8ec13-5114-4633-ac9e-f1b790529dd0,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:11Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a295446-f3f9-4ea9-847d-7db38ad09929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a295446-f3f9-4ea9-847d-7db38ad09929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbb4903-5fdf-4194-a35e-3f1bada4b0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edbb4903-5fdf-4194-a35e-3f1bada4b0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ba44f189-8e4d-4e56-b929-1b0f252e4a34', 'volume_name': 'volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34', 'volume_size': 1, 'source_volid': 'd5e8ec13-5114-4633-ac9e-f1b790529dd0', 'source_volstatus': 'available'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8afd991-e104-4c9b-b401-89493eea7875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8afd991-e104-4c9b-b401-89493eea7875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:11 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c46770-357f-4b5e-8739-1b71739a401e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:11 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Volume ba44f189-8e4d-4e56-b929-1b0f252e4a34: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34', 'volume_size': 1, 'source_volid': 'd5e8ec13-5114-4633-ac9e-f1b790529dd0', 'source_volstatus': 'available'} Apr 10 10:41:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:12 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img" returned: 0 in 1.954s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:12 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2851e89-7395-475d-b653-80bf0b1019ee]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:12 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 Apr 10 10:41:12 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:13 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" returned: 0 in 0.660s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:13 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:41:13 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Converted 1024.00 MB image at 523.92 MB/s Apr 10 10:41:13 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] c590d957-1e55-40a0-82eb-3136de0c49f4 was raw, converting to qcow2 {{(pid=82038) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 10 10:41:13 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a9d0c89-3be3-4d48-9367-428a6b7c87e6]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:13 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img Apr 10 10:41:13 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:13 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img" returned: 0 in 0.495s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:13 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img Apr 10 10:41:13 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:14 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img" returned: 1 in 0.465s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:41:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img /opt/stack/data/cinder/conversion/vol_upload_gvo4z3zu {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:14 devstack sudo[88590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img /opt/stack/data/cinder/conversion/vol_upload_gvo4z3zu Apr 10 10:41:14 devstack sudo[88590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:14 devstack sudo[88590]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img /opt/stack/data/cinder/conversion/vol_upload_gvo4z3zu" returned: 0 in 0.434s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:14 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Image conversion details: src /opt/stack/data/cinder/conversion/4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1.temp_image.c590d957-1e55-40a0-82eb-3136de0c49f4ztxfit70.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_gvo4z3zu {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:41:14 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 10 10:41:14 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae67fef1-65dc-46c4-8f65-05234cfb47d0]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gvo4z3zu {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:14 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gvo4z3zu Apr 10 10:41:14 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:15 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_gvo4z3zu" returned: 0 in 0.494s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.494s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Uploaded volume to glance image-id: c590d957-1e55-40a0-82eb-3136de0c49f4. {{(pid=82038) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 10:41:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 4.810s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:15 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Cloning volume d5e8ec13-5114-4633-ac9e-f1b790529dd0 to volume ba44f189-8e4d-4e56-b929-1b0f252e4a34 Apr 10 10:41:15 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4a307c73-5406-4f48-9b07-6d9cd88d5e52 tempest-VolumesActionsTest-1354903456 None] Copy volume to image completed successfully. Apr 10 10:41:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Creating offline snapshot e36969a2-28d0-410f-b5c1-f079a369f705 of volume d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:41:16 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b6ea8-c9a0-4a14-bda7-9a08de5efe9a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:16 devstack sudo[88602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 Apr 10 10:41:16 devstack sudo[88602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:16 devstack sudo[88602]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0" returned: 0 in 0.542s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:16 devstack sudo[88607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 1G Apr 10 10:41:16 devstack sudo[88607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Acquiring lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Acquiring lock "cinder-quobyte-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Lock "cinder-quobyte-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:16 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[36dd4a86-8505-4d96-b694-ea50c1dc72bb]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack sudo[88612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 Apr 10 10:41:17 devstack sudo[88612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:17 devstack sudo[88607]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 1G" returned: 0 in 0.523s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack sudo[88614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 Apr 10 10:41:17 devstack sudo[88614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:17 devstack sudo[88612]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" returned: 0 in 0.473s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack sudo[88619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1 Apr 10 10:41:17 devstack sudo[88619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:17 devstack sudo[88614]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705" returned: 0 in 0.430s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:17 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 is being set with open permissions: ugo+rw Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 Apr 10 10:41:17 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:17 devstack sudo[88619]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" returned: 0 in 0.400s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Lock "cinder-quobyte-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1" released by "delete_volume" :: held 0.893s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Created reservations ['b32dcc59-cd0a-4c11-9e23-8f6764c9e46c', 'dacbc9b5-6b3f-4258-820a-11c485d2da4b', 'bf03f386-3705-4f8d-8929-be516bab991d', '068b114c-9a3f-4333-8930-7f1dbb220558'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:41:17 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:17 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705" returned: 0 in 0.430s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:17 devstack sudo[88630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.info Apr 10 10:41:17 devstack sudo[88630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:18 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.467s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:18 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Deleted volume successfully. Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-18a1f61f-03e3-468b-90e9-842299df0da3 tempest-VolumesActionsTest-1354903456 None] Lock "cinder-4ecde5e2-67f0-4f07-a08d-08ffb8ce25a1-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:18 devstack sudo[88630]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.info" returned: 0 in 0.472s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:18 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.info is being set with open permissions: ugo+rw Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:18 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.info Apr 10 10:41:18 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:18 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.info" returned: 0 in 0.446s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-quobyte-ba44f189-8e4d-4e56-b929-1b0f252e4a34" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-ba44f189-8e4d-4e56-b929-1b0f252e4a34" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] snapshot: e36969a2-28d0-410f-b5c1-f079a369f705, volume: ba44f189-8e4d-4e56-b929-1b0f252e4a34, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b6b82-d8e4-49f6-bf2f-338137671712]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:18 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 Apr 10 10:41:18 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:19 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705" returned: 0 in 0.529s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:41:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:41:19 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc77c65-be8a-4b7e-ad88-e83c790486a6]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:19 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 Apr 10 10:41:19 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:19 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0" returned: 0 in 0.502s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:19 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:41:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:19 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 Apr 10 10:41:19 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:22 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34" returned: 0 in 2.150s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88d5898-6238-4261-8feb-0de04f9091ea]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:22 devstack sudo[88663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 Apr 10 10:41:22 devstack sudo[88663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:22 devstack sudo[88663]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0" returned: 0 in 0.666s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0, size 1024.00 MB, duration 2.15 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:41:22 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Converted 1024.00 MB image at 475.94 MB/s Apr 10 10:41:22 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 is being set with open permissions: ugo+rw Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:22 devstack sudo[88668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 Apr 10 10:41:22 devstack sudo[88668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Flow 'volume_create_manager' (18386e65-fdeb-4ebe-96a4-7a81ce5d3540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad191c72-fa43-476d-a9c6-ddc509fdc334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad191c72-fa43-476d-a9c6-ddc509fdc334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64d6eb8-7e8a-4171-a83b-f69c5708551c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd4cbe5b3744b7a8f10db6004e3f388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:23Z,use_quota=True,user_id='12f8829306c94100b6aeba9f1e805a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54977028-4f4d-4f73-a938-eb47a2f74636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54977028-4f4d-4f73-a938-eb47a2f74636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5659f185-3185-4030-991b-10551d43caf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5659f185-3185-4030-991b-10551d43caf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd64d6eb8-7e8a-4171-a83b-f69c5708551c', 'volume_name': 'volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48577cee-c533-4f68-8d0e-b2c65900ea70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48577cee-c533-4f68-8d0e-b2c65900ea70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407f3235-899c-4037-910f-8f5223fa0c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:22 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Volume d64d6eb8-7e8a-4171-a83b-f69c5708551c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c', 'volume_size': 1} Apr 10 10:41:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:23 devstack sudo[88668]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34" returned: 0 in 0.429s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-ba44f189-8e4d-4e56-b929-1b0f252e4a34" released by "_copy_volume_from_snapshot" :: held 4.320s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-quobyte-e36969a2-28d0-410f-b5c1-f079a369f705" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-e36969a2-28d0-410f-b5c1-f079a369f705" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Deleting offline snapshot e36969a2-28d0-410f-b5c1-f079a369f705 of volume d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] snapshot_file for this snap is: volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9f6d59-7fa3-41f2-907d-1abcb0904e1f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:23 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 Apr 10 10:41:23 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:23 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705" returned: 0 in 0.507s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabe08db-9e32-44cd-8611-4694683591e6]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:23 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 Apr 10 10:41:23 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:24 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0" returned: 0 in 0.493s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:24 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 Apr 10 10:41:24 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:24 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705" returned: 0 in 0.458s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:24 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705 Apr 10 10:41:24 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:25 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0.e36969a2-28d0-410f-b5c1-f079a369f705" returned: 0 in 0.420s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-e36969a2-28d0-410f-b5c1-f079a369f705" released by "_delete_snapshot" :: held 1.941s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.216s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.188s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:23Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d64d6eb8-7e8a-4171-a83b-f69c5708551c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd4cbe5b3744b7a8f10db6004e3f388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:23Z,use_quota=True,user_id='12f8829306c94100b6aeba9f1e805a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Creating volume d64d6eb8-7e8a-4171-a83b-f69c5708551c {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:25 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61c46770-357f-4b5e-8739-1b71739a401e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34', 'volume_size': 1, 'source_volid': 'd5e8ec13-5114-4633-ac9e-f1b790529dd0', 'source_volstatus': 'available'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:25 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c 1073741824 Apr 10 10:41:25 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69fe14e-4837-4763-a9a7-879920e05852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:25 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Volume volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 (ba44f189-8e4d-4e56-b929-1b0f252e4a34): created successfully Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e69fe14e-4837-4763-a9a7-879920e05852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (534efc9d-2c4b-4647-b020-fafccb150bfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:25 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-36d50b9a-3a30-4ed3-8c77-106e6821b532 tempest-VolumesGetTest-705748558 None] Created volume successfully. Apr 10 10:41:25 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c 1073741824" returned: 0 in 0.510s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:25 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c Apr 10 10:41:25 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (6018b6b2-6766-4e70-a457-ed99c17f9a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1c252a-d3aa-4fbc-8176-f79b29b69b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1c252a-d3aa-4fbc-8176-f79b29b69b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1946807564',display_name='tempest-VolumesGetTest-Volume-789053170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f58032f-aa99-428e-ac3d-0272ed99541d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:26Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4a7121-0936-44f4-9b80-29c99c0b5a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b4a7121-0936-44f4-9b80-29c99c0b5a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44500af2-4b61-4df6-b1b0-2a7e82346de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44500af2-4b61-4df6-b1b0-2a7e82346de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f58032f-aa99-428e-ac3d-0272ed99541d', 'volume_name': 'volume-2f58032f-aa99-428e-ac3d-0272ed99541d', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:26 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37293837-d5e3-4379-a098-d52a531ff4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37293837-d5e3-4379-a098-d52a531ff4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f9217c-5d4e-41cb-abfe-61686f4831f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:26 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Volume 2f58032f-aa99-428e-ac3d-0272ed99541d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f58032f-aa99-428e-ac3d-0272ed99541d', 'volume_size': 1} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c" returned: 0 in 0.532s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:26Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1946807564',display_name='tempest-VolumesGetTest-Volume-789053170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f58032f-aa99-428e-ac3d-0272ed99541d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:26Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Creating volume 2f58032f-aa99-428e-ac3d-0272ed99541d {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:26 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407f3235-899c-4037-910f-8f5223fa0c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:26 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d 1073741824 Apr 10 10:41:26 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffb6983-4bc9-43c8-94c5-6f30037d0cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:26 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Volume volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c (d64d6eb8-7e8a-4171-a83b-f69c5708551c): created successfully Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ffb6983-4bc9-43c8-94c5-6f30037d0cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Flow 'volume_create_manager' (18386e65-fdeb-4ebe-96a4-7a81ce5d3540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:26 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b63e0549-76ff-43b5-b6fe-946a7a789405 tempest-CinderUnicodeTest-410429410 None] Created volume successfully. Apr 10 10:41:26 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d 1073741824" returned: 0 in 0.475s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:26 devstack sudo[88702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d Apr 10 10:41:26 devstack sudo[88702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:27 devstack sudo[88702]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d" returned: 0 in 0.440s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05f9217c-5d4e-41cb-abfe-61686f4831f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f58032f-aa99-428e-ac3d-0272ed99541d', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955f6db2-50de-4cab-8c4b-efb15495bc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:27 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Volume volume-2f58032f-aa99-428e-ac3d-0272ed99541d (2f58032f-aa99-428e-ac3d-0272ed99541d): created successfully Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (955f6db2-50de-4cab-8c4b-efb15495bc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (6018b6b2-6766-4e70-a457-ed99c17f9a84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:27 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-162227e9-6177-410a-bd49-fe48cd93d31c tempest-VolumesGetTest-705748558 None] Created volume successfully. Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Flow 'volume_create_manager' (4c282fc5-6f72-4710-a5a3-af10c46fca46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ade65b0-25aa-4231-947c-cf2bc28b8ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ade65b0-25aa-4231-947c-cf2bc28b8ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1297376160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd4cbe5b3744b7a8f10db6004e3f388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:27Z,use_quota=True,user_id='12f8829306c94100b6aeba9f1e805a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab66961-2969-41f0-a730-90a596741734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ab66961-2969-41f0-a730-90a596741734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfff545e-1582-4b5b-9b90-656e61bc7272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfff545e-1582-4b5b-9b90-656e61bc7272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b', 'volume_name': 'volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959db5e0-7e79-436e-ab0f-d7cc11a1edb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959db5e0-7e79-436e-ab0f-d7cc11a1edb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd72626c-b25a-4aca-bbae-4b12ed3f675c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:27 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Volume 4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b', 'volume_size': 1} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1297376160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfd4cbe5b3744b7a8f10db6004e3f388',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:27Z,use_quota=True,user_id='12f8829306c94100b6aeba9f1e805a0d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Creating volume 4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:27 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:41:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:27 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b 1073741824 Apr 10 10:41:27 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:28 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b 1073741824" returned: 0 in 0.466s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:28 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b Apr 10 10:41:28 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-2f58032f-aa99-428e-ac3d-0272ed99541d-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Lock "cinder-2f58032f-aa99-428e-ac3d-0272ed99541d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-quobyte-2f58032f-aa99-428e-ac3d-0272ed99541d" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-2f58032f-aa99-428e-ac3d-0272ed99541d" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e808829-5b5d-4cb5-ae5f-24669c32f872]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:28 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d Apr 10 10:41:28 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:28 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" returned: 0 in 0.526s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd72626c-b25a-4aca-bbae-4b12ed3f675c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f3cc88-1bfe-42fe-bfde-295af997f3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:28 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Volume volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b (4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b): created successfully Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56f3cc88-1bfe-42fe-bfde-295af997f3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Flow 'volume_create_manager' (4c282fc5-6f72-4710-a5a3-af10c46fca46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:28 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-1aed3f8b-e061-4584-914c-9313994b4552 tempest-CinderUnicodeTest-410429410 None] Created volume successfully. Apr 10 10:41:28 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d" returned: 0 in 0.522s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:29 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d Apr 10 10:41:29 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:29 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2f58032f-aa99-428e-ac3d-0272ed99541d" returned: 0 in 0.452s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-2f58032f-aa99-428e-ac3d-0272ed99541d" released by "delete_volume" :: held 1.009s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Created reservations ['e6860dff-ed76-4397-a518-c0787ee0d7b3', '9dc00466-0c4f-45b9-86e7-a103a4a23f12', 'b81538f6-8a4f-4501-b960-def5063faf85', '979e7efc-6344-468c-bbfb-6abe92aba05d'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:29 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:41:29 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Creating offline snapshot fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 of volume 4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03a280e-e654-45c1-bbc5-25420c86b5e3]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:29 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b Apr 10 10:41:29 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:30 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.459s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:30 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Deleted volume successfully. Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f10989ed-fab8-4205-ba69-42e204ca1219 tempest-VolumesGetTest-705748558 None] Lock "cinder-2f58032f-aa99-428e-ac3d-0272ed99541d-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:30 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" returned: 0 in 0.453s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:30 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 1G Apr 10 10:41:30 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-ba44f189-8e4d-4e56-b929-1b0f252e4a34-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Lock "cinder-ba44f189-8e4d-4e56-b929-1b0f252e4a34-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-quobyte-ba44f189-8e4d-4e56-b929-1b0f252e4a34" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-ba44f189-8e4d-4e56-b929-1b0f252e4a34" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[33db6518-5a70-4115-8495-a794f8d54cfe]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:30 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 Apr 10 10:41:30 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:30 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 1G" returned: 0 in 0.481s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:30 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 Apr 10 10:41:30 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:31 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34" returned: 0 in 0.485s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:31 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34 Apr 10 10:41:31 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:31 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13" returned: 0 in 0.423s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:31 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 is being set with open permissions: ugo+rw Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:31 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 Apr 10 10:41:31 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:31 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba44f189-8e4d-4e56-b929-1b0f252e4a34" returned: 0 in 0.416s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-ba44f189-8e4d-4e56-b929-1b0f252e4a34" released by "delete_volume" :: held 0.927s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Created reservations ['8acad76a-5e1a-4b86-ba44-7cb8aab67d5e', '39746239-0ecb-42c5-b461-c39074db9eb7', '921930de-5449-4de5-b182-ffe7ae74e885', '6e1d929b-701c-472d-87c9-02103750afa1'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:31 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13" returned: 0 in 0.426s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:31 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:41:31 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:31 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.info Apr 10 10:41:31 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-d5e8ec13-5114-4633-ac9e-f1b790529dd0-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Lock "cinder-d5e8ec13-5114-4633-ac9e-f1b790529dd0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-quobyte-d5e8ec13-5114-4633-ac9e-f1b790529dd0" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-d5e8ec13-5114-4633-ac9e-f1b790529dd0" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b925d5de-f084-4383-9903-9f07883e8ebe]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:31 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 Apr 10 10:41:31 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:32 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.496s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:32 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Deleted volume successfully. Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-674729bb-705b-4320-b88d-52637e781c5f tempest-VolumesGetTest-705748558 None] Lock "cinder-ba44f189-8e4d-4e56-b929-1b0f252e4a34-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:32 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.info" returned: 0 in 0.510s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:32 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.info is being set with open permissions: ugo+rw Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:32 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.info Apr 10 10:41:32 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:32 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0" returned: 0 in 0.492s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:32 devstack sudo[88764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0 Apr 10 10:41:32 devstack sudo[88764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:32 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.info" returned: 0 in 0.440s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.807s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:32 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0400bdd8-bee4-49be-9454-b4c2ad23786e tempest-CinderUnicodeTest-410429410 None] Create snapshot completed successfully Apr 10 10:41:32 devstack sudo[88764]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d5e8ec13-5114-4633-ac9e-f1b790529dd0" returned: 0 in 0.434s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-d5e8ec13-5114-4633-ac9e-f1b790529dd0" released by "delete_volume" :: held 0.961s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Created reservations ['eed340f7-b65d-4f67-b87e-2f36d5f990cc', 'cfbdd0e2-2e6f-44ac-8b88-c572624bc787', '32ad3760-0b49-4a87-bb15-7a9cc0362a7d', 'e4641724-0226-4296-be32-e3239274231b'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:32 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:41:32 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "cinder-fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "cinder-quobyte-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-quobyte-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "cinder-quobyte-fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-quobyte-fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Deleting offline snapshot fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 of volume 4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] snapshot_file for this snap is: volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[70382e52-8038-481e-86bc-859fa6ec8873]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:33 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 Apr 10 10:41:33 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:33 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.432s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:33 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Deleted volume successfully. Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-dde5415c-4870-4d0d-b6e5-8c5ee3c8a293 tempest-VolumesGetTest-705748558 None] Lock "cinder-d5e8ec13-5114-4633-ac9e-f1b790529dd0-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:33 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13" returned: 0 in 0.469s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f0a787-673b-4542-ba19-b12856ee3574]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:33 devstack sudo[88776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b Apr 10 10:41:33 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:33 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" returned: 0 in 0.470s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:34 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 Apr 10 10:41:34 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (22014e95-a6fe-42ed-a8ac-11b420083511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3401c7e8-4885-4c09-ace5-69b2f84b9025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3401c7e8-4885-4c09-ace5-69b2f84b9025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1363826419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814397aa-ecd1-4472-8942-30c7bf40470a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:34Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5cdf5b-d709-4040-8e60-c72d92139445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5cdf5b-d709-4040-8e60-c72d92139445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4f778a-0a7c-4bf8-8e38-ff83300b6ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.image.glance [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Creating Keystone auth plugin from conf {{(pid=82038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 10:41:34 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13" returned: 0 in 0.528s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:34 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13 Apr 10 10:41:34 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c4f778a-0a7c-4bf8-8e38-ff83300b6ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '814397aa-ecd1-4472-8942-30c7bf40470a', 'volume_name': 'volume-814397aa-ecd1-4472-8942-30c7bf40470a', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12030b2-9164-450e-a9cc-2022a07f7970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e12030b2-9164-450e-a9cc-2022a07f7970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18002d4-fcef-4c7f-9d14-1a641b114e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:34 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Volume 814397aa-ecd1-4472-8942-30c7bf40470a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-814397aa-ecd1-4472-8942-30c7bf40470a', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Trying to clone 814397aa-ecd1-4472-8942-30c7bf40470a from image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc at location (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]). {{(pid=82038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 10:41:34 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Image download 20.69 MB at 20.69 MB/s Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaeed73-6649-4e5b-9f8b-b3f8f9b57945]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:34 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b.fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13" returned: 0 in 0.449s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-quobyte-fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13" released by "_delete_snapshot" :: held 1.971s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-quobyte-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" released by "delete_snapshot" :: held 1.984s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:35 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD Apr 10 10:41:35 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Created reservations ['f78d8838-f586-4506-88a0-e1d12a74c2bf', '70337c11-2a75-4805-8e3c-90d8febe9d4d', 'bca15506-b896-413f-acf6-1a2b58325afc', '6a9ccdbc-559b-4995-9629-58b581ca0653'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:35 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Delete snapshot completed successfully. Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bec08c45-9426-4fb9-90bf-95a18cc80c90 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-fdbb2abe-5aa2-4447-9b48-a6fa6fda7e13-delete_snapshot" released by "delete_snapshot" :: held 2.070s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:35 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Temporary image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc is fetched for user ba84c22fd9fd4663a3e0c8e4840afcf9. {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[856697e3-dd13-4aa2-8acd-8018f1fb45f9]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:35 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD Apr 10 10:41:35 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:35 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1363826419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814397aa-ecd1-4472-8942-30c7bf40470a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:34Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Creating volume 814397aa-ecd1-4472-8942-30c7bf40470a {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:35 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:41:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:35 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a 1073741824 Apr 10 10:41:35 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "cinder-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "cinder-quobyte-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-quobyte-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1fa9bb-ae53-45d2-a6fd-e3761d72233c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:36 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b Apr 10 10:41:36 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:36 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a 1073741824" returned: 0 in 0.480s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:36 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a Apr 10 10:41:36 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:36 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" returned: 0 in 0.468s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:36 devstack sudo[88812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b Apr 10 10:41:36 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:36 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a" returned: 0 in 0.427s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Attempting download of de7026ff-34c2-4bec-b6ea-0aa44cfce4dc ((None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}])) to volume 814397aa-ecd1-4472-8942-30c7bf40470a. {{(pid=82038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8080f51-9755-4681-9be1-bddbbda99c19]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc__5ogybbh {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:36 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc__5ogybbh Apr 10 10:41:36 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:37 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" returned: 0 in 0.420s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-quobyte-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b" released by "delete_volume" :: held 0.921s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Created reservations ['3d0beeae-68c2-41b9-8dd9-58e4dcf46182', 'c75f10dd-fa1e-4d2a-bcbe-7ab7870f0f98', 'bd3f1c91-7e42-4349-b383-9afe8c370f47', 'c415b979-75b3-4454-8ae9-dfa4d6a7a8a0'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:37 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:41:37 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "cinder-d64d6eb8-7e8a-4171-a83b-f69c5708551c-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-d64d6eb8-7e8a-4171-a83b-f69c5708551c-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "cinder-quobyte-d64d6eb8-7e8a-4171-a83b-f69c5708551c" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-quobyte-d64d6eb8-7e8a-4171-a83b-f69c5708551c" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2427b3-3bdf-444a-bdf5-05c82655f0d2]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:37 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc__5ogybbh" returned: 0 in 0.482s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc__5ogybbh {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:37 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c Apr 10 10:41:37 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:37 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc__5ogybbh Apr 10 10:41:37 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:37 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.470s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:37 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Deleted volume successfully. Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4ad52450-835b-41af-a1af-a5095fc8e0f1 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-4c9ab0f7-9c31-4c1c-b07a-a8b6ecaa225b-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:37 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c" returned: 0 in 0.510s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:37 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc__5ogybbh" returned: 1 in 0.467s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:37 devstack sudo[88832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c Apr 10 10:41:37 devstack sudo[88832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc__5ogybbh' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b9ed57-5894-4b11-b314-1f023218a7d8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:37 devstack sudo[88834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD Apr 10 10:41:37 devstack sudo[88834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:38 devstack sudo[88832]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-d64d6eb8-7e8a-4171-a83b-f69c5708551c" returned: 0 in 0.402s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-quobyte-d64d6eb8-7e8a-4171-a83b-f69c5708551c" released by "delete_volume" :: held 0.945s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Created reservations ['d9747d1a-0058-4a33-9dda-38c7a3588193', '411ac267-0d90-443a-8e31-74944966178b', '65083483-d2ce-48fa-84d8-b19c01a5c970', '47eb907a-1629-47f1-a804-f0959dc06fa0'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:38 devstack sudo[88834]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] de7026ff-34c2-4bec-b6ea-0aa44cfce4dc was qcow2, converting to raw {{(pid=82038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:38 devstack sudo[88840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:41:38 devstack sudo[88840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:38 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a Apr 10 10:41:38 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:38 devstack sudo[88840]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.553s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:38 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Deleted volume successfully. Apr 10 10:41:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-6138df59-88a6-4053-8f12-a37ea45ff119 tempest-CinderUnicodeTest-410429410 None] Lock "cinder-d64d6eb8-7e8a-4171-a83b-f69c5708551c-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:39 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:41:39 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:39 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a" returned: 0 in 0.993s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_de7026ff-34c2-4bec-b6ea-0aa44cfce4dc_y0bscy5vdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:41:39 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Converted 112.00 MB image at 112.00 MB/s Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:39 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a 1G Apr 10 10:41:39 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:39 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.504s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:39 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a 1G" returned: 0 in 0.549s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[749877e8-91cc-4728-8742-f828f0e9aba8]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:39 devstack sudo[88869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a Apr 10 10:41:39 devstack sudo[88869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:40 devstack sudo[88869]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a" returned: 0 in 0.529s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:40 devstack sudo[88873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a Apr 10 10:41:40 devstack sudo[88873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:41 devstack sudo[88873]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a" returned: 1 in 0.562s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Downloaded image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc ((None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}])) to volume 814397aa-ecd1-4472-8942-30c7bf40470a successfully. {{(pid=82038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Temporary image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc for user ba84c22fd9fd4663a3e0c8e4840afcf9 is deleted. {{(pid=82038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG cinder.volume.volume_utils [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Marking volume 814397aa-ecd1-4472-8942-30c7bf40470a as bootable. {{(pid=82038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Copying metadata from image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc to 814397aa-ecd1-4472-8942-30c7bf40470a. {{(pid=82038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Creating volume glance metadata for volume 814397aa-ecd1-4472-8942-30c7bf40470a backed by image de7026ff-34c2-4bec-b6ea-0aa44cfce4dc with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18002d4-fcef-4c7f-9d14-1a641b114e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814397aa-ecd1-4472-8942-30c7bf40470a', 'volume_size': 1, 'image_id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '0500fbec832a4ae6ab1b14e476d3e914', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'de7026ff-34c2-4bec-b6ea-0aa44cfce4dc', 'created_at': datetime.datetime(2026, 4, 10, 8, 27, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 8, 27, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/de7026ff-34c2-4bec-b6ea-0aa44cfce4dc/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0441272-064e-4276-9b00-e3d64e3fe5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:41 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Volume volume-814397aa-ecd1-4472-8942-30c7bf40470a (814397aa-ecd1-4472-8942-30c7bf40470a): created successfully Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0441272-064e-4276-9b00-e3d64e3fe5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:41 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (22014e95-a6fe-42ed-a8ac-11b420083511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:41 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-dc697f40-e558-4035-910d-9e487ce1abff tempest-VolumesGetTest-705748558 None] Created volume successfully. Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (0a06436a-9ff2-4ce6-8e78-47827ed4253a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e46626-eb42-44b6-a160-df94695a1759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e46626-eb42-44b6-a160-df94695a1759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-336060123',display_name='tempest-VolumesGetTest-Volume-2144471362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b3692a-821a-4966-81a0-674eeaaf430d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:42Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b74b17e-b6df-4193-a234-d918b4d16367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b74b17e-b6df-4193-a234-d918b4d16367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ace75c-3b95-4976-a99d-7b1a00b48cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78ace75c-3b95-4976-a99d-7b1a00b48cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4b3692a-821a-4966-81a0-674eeaaf430d', 'volume_name': 'volume-c4b3692a-821a-4966-81a0-674eeaaf430d', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43819c4e-4e3e-4af1-9148-d48fcb9936df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43819c4e-4e3e-4af1-9148-d48fcb9936df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e856f2-0ee5-4353-93a8-cb88b8d59705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:42 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Volume c4b3692a-821a-4966-81a0-674eeaaf430d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4b3692a-821a-4966-81a0-674eeaaf430d', 'volume_size': 1} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-336060123',display_name='tempest-VolumesGetTest-Volume-2144471362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4b3692a-821a-4966-81a0-674eeaaf430d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e318594f4c124ed79d4558e239ed0650',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:42Z,use_quota=True,user_id='ba84c22fd9fd4663a3e0c8e4840afcf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Creating volume c4b3692a-821a-4966-81a0-674eeaaf430d {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:42 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:42 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d 1073741824 Apr 10 10:41:42 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:42 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d 1073741824" returned: 0 in 0.548s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:42 devstack sudo[88884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d Apr 10 10:41:42 devstack sudo[88884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:43 devstack sudo[88884]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d" returned: 0 in 0.513s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34e856f2-0ee5-4353-93a8-cb88b8d59705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4b3692a-821a-4966-81a0-674eeaaf430d', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80121afd-970b-4570-abf6-1f595c4b6713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:43 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Volume volume-c4b3692a-821a-4966-81a0-674eeaaf430d (c4b3692a-821a-4966-81a0-674eeaaf430d): created successfully Apr 10 10:41:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80121afd-970b-4570-abf6-1f595c4b6713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:43 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Flow 'volume_create_manager' (0a06436a-9ff2-4ce6-8e78-47827ed4253a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:43 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4657d756-e88b-40b7-91bb-4d7c07facfde tempest-VolumesGetTest-705748558 None] Created volume successfully. Apr 10 10:41:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-c4b3692a-821a-4966-81a0-674eeaaf430d-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Lock "cinder-c4b3692a-821a-4966-81a0-674eeaaf430d-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-quobyte-c4b3692a-821a-4966-81a0-674eeaaf430d" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-c4b3692a-821a-4966-81a0-674eeaaf430d" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:44 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5ceae5-e308-4cfe-8c37-8b7cca483c60]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:44 devstack sudo[88887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d Apr 10 10:41:44 devstack sudo[88887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:45 devstack sudo[88887]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d" returned: 0 in 0.566s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:45 devstack sudo[88892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d Apr 10 10:41:45 devstack sudo[88892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:45 devstack sudo[88892]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c4b3692a-821a-4966-81a0-674eeaaf430d" returned: 0 in 0.512s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-c4b3692a-821a-4966-81a0-674eeaaf430d" released by "delete_volume" :: held 1.108s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Created reservations ['daa983ae-3a16-4220-bd4e-60d673ab3f87', '91aec2f5-c75c-4ca7-bc52-e075dbd85490', '56c6935d-3b36-4978-84c1-f31214c82eb9', 'b08f47fb-9e50-4155-83ab-246e2a123318'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:45 devstack sudo[88895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:41:45 devstack sudo[88895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:46 devstack sudo[88895]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.459s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:46 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:46 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Deleted volume successfully. Apr 10 10:41:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-21a65564-e916-4b6f-9e0e-dc46ceb9ffb7 tempest-VolumesGetTest-705748558 None] Lock "cinder-c4b3692a-821a-4966-81a0-674eeaaf430d-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-814397aa-ecd1-4472-8942-30c7bf40470a-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Lock "cinder-814397aa-ecd1-4472-8942-30c7bf40470a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Acquiring lock "cinder-quobyte-814397aa-ecd1-4472-8942-30c7bf40470a" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:41:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-814397aa-ecd1-4472-8942-30c7bf40470a" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:41:46 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2b1273-c001-4bd4-9b8f-453beba05022]: (4, 'raw') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:46 devstack sudo[88898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a Apr 10 10:41:46 devstack sudo[88898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:47 devstack sudo[88898]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a" returned: 0 in 0.516s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:47 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a Apr 10 10:41:47 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:47 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a" returned: 1 in 0.494s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a' failed. Not Retrying. {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 10:41:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:47 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a Apr 10 10:41:47 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:48 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-814397aa-ecd1-4472-8942-30c7bf40470a" returned: 0 in 0.418s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Lock "cinder-quobyte-814397aa-ecd1-4472-8942-30c7bf40470a" released by "delete_volume" :: held 1.485s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Created reservations ['974fc06a-bcd6-431f-97ba-aa098b560969', 'c52b1fa5-0f64-4667-968d-6b99df6eef8f', 'e01d5f85-a574-404d-921a-e38242ec6478', 'f9694b9e-e58f-4f95-b481-f73b7d369f89'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:48 devstack sudo[88916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:41:48 devstack sudo[88916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:48 devstack sudo[88916]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.474s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:41:48 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Deleted volume successfully. Apr 10 10:41:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f4b87501-a5d3-44bf-bb68-16fd343e1434 tempest-VolumesGetTest-705748558 None] Lock "cinder-814397aa-ecd1-4472-8942-30c7bf40470a-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Flow 'volume_create_manager' (03097e35-47e5-47ba-952f-ed396df022d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ded5188-7c77-495a-9679-eb9df0214537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ded5188-7c77-495a-9679-eb9df0214537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1286723085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b9e34fb4704d498a8b91fcbaa46f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:56Z,use_quota=True,user_id='e7f0b69a5f194228b61784898173c2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044ee5a1-3f00-4765-9f59-b6fdc707feb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044ee5a1-3f00-4765-9f59-b6fdc707feb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04602554-5215-45ba-ba30-f5ed7a0053f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04602554-5215-45ba-ba30-f5ed7a0053f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6', 'volume_name': 'volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ca86aa-9141-4d9a-8741-d73d699f172a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60ca86aa-9141-4d9a-8741-d73d699f172a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971ddca4-d752-448c-8f75-bad17d8056b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:56 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Volume e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6', 'volume_size': 1} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1286723085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b9e34fb4704d498a8b91fcbaa46f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:56Z,use_quota=True,user_id='e7f0b69a5f194228b61784898173c2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Creating volume e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:41:56 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:56 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 1073741824 Apr 10 10:41:56 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:56 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 1073741824" returned: 0 in 0.596s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:57 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 Apr 10 10:41:57 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:57 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" returned: 0 in 0.561s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:41:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:41:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971ddca4-d752-448c-8f75-bad17d8056b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe5d8fc-12e6-4fae-8b4e-6ec47e969ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:57 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Volume volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 (e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6): created successfully Apr 10 10:41:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fe5d8fc-12e6-4fae-8b4e-6ec47e969ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Flow 'volume_create_manager' (03097e35-47e5-47ba-952f-ed396df022d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:57 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e113587e-e768-4d28-9797-61a8cadccb4a tempest-SnapshotDependencyTests-759796196 None] Created volume successfully. Apr 10 10:41:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:41:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Creating offline snapshot 696614f3-4d47-4fd8-8989-6eaf08220cd6 of volume e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:41:58 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[544a763b-83cb-48eb-a2c8-0cfb5ff3ec15]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:41:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:58 devstack sudo[88929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 Apr 10 10:41:58 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:59 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" returned: 0 in 0.599s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:59 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 1G Apr 10 10:41:59 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Flow 'volume_create_manager' (9627b387-372f-42f7-b47b-4d2a489382cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43592df7-2dc4-4cd8-85f5-d143e5c84807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43592df7-2dc4-4cd8-85f5-d143e5c84807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1147713960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a816486-caf4-4317-8ab7-dcaa97fc0c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41753d0d302467b853d9d9fcef70397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:59Z,use_quota=True,user_id='a7fe68217adb4861aa3da63790e05915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cd9e24-dd94-4b76-b5c9-a23f9fd6738d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1cd9e24-dd94-4b76-b5c9-a23f9fd6738d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4493b501-46a8-41a9-b79c-75f2b03d68a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4493b501-46a8-41a9-b79c-75f2b03d68a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a816486-caf4-4317-8ab7-dcaa97fc0c81', 'volume_name': 'volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780d6a26-56a8-4df8-a0dc-c040d2f9e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (780d6a26-56a8-4df8-a0dc-c040d2f9e14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73efb08b-0e3c-4cbc-82f4-77f8e5dda5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:41:59 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume 2a816486-caf4-4317-8ab7-dcaa97fc0c81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81', 'volume_size': 1} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:41:59 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 1G" returned: 0 in 0.536s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:41:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:41:59 devstack sudo[88939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 Apr 10 10:41:59 devstack sudo[88939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:00 devstack sudo[88939]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6" returned: 0 in 0.410s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:00 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 is being set with open permissions: ugo+rw Apr 10 10:42:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:00 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 Apr 10 10:42:00 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:00 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6" returned: 0 in 0.404s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:00 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.info Apr 10 10:42:00 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:01 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.info" returned: 0 in 0.424s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:01 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.info is being set with open permissions: ugo+rw Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:01 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.info Apr 10 10:42:01 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:01 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.info" returned: 0 in 0.553s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.020s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.226s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:41:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1147713960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a816486-caf4-4317-8ab7-dcaa97fc0c81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41753d0d302467b853d9d9fcef70397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:41:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:41:59Z,use_quota=True,user_id='a7fe68217adb4861aa3da63790e05915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Creating volume 2a816486-caf4-4317-8ab7-dcaa97fc0c81 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:01 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:42:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:01 devstack sudo[88987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 1073741824 Apr 10 10:42:01 devstack sudo[88987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:01 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-04de0a3c-c8d7-44c9-9d36-9e4f9ba6abe6 tempest-SnapshotDependencyTests-759796196 None] Create snapshot completed successfully Apr 10 10:42:02 devstack sudo[88987]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 1073741824" returned: 0 in 0.658s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:02 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 Apr 10 10:42:02 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:02 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81" returned: 0 in 0.513s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.220s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73efb08b-0e3c-4cbc-82f4-77f8e5dda5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d478b6af-833a-4c15-9cc3-b507be928bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:02 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 (2a816486-caf4-4317-8ab7-dcaa97fc0c81): created successfully Apr 10 10:42:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d478b6af-833a-4c15-9cc3-b507be928bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:02 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Flow 'volume_create_manager' (9627b387-372f-42f7-b47b-4d2a489382cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:02 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c5746ec0-476f-48bb-ad5f-f3adff3f6e15 tempest-VolumesSnapshotTestJSON-1817325069 None] Created volume successfully. Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Flow 'volume_create_manager' (cd1054fe-cd7f-4cec-9c1d-a4b9446a288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e362d4b8-e5f1-4574-b360-b3adfc3879c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e362d4b8-e5f1-4574-b360-b3adfc3879c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb3c920-48ff-483d-8c95-51ff7db668c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47b9e34fb4704d498a8b91fcbaa46f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=696614f3-4d47-4fd8-8989-6eaf08220cd6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:03Z,use_quota=True,user_id='e7f0b69a5f194228b61784898173c2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad047578-0faa-4885-a8fa-a627048574d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad047578-0faa-4885-a8fa-a627048574d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fb69ae-e0f9-4e29-a027-d11f6bca3c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72fb69ae-e0f9-4e29-a027-d11f6bca3c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9cb3c920-48ff-483d-8c95-51ff7db668c0', 'volume_name': 'volume-9cb3c920-48ff-483d-8c95-51ff7db668c0', 'volume_size': 1, 'snapshot_id': '696614f3-4d47-4fd8-8989-6eaf08220cd6'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c06ec80-632c-47d9-9a7d-1e34fa463785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c06ec80-632c-47d9-9a7d-1e34fa463785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b264063b-ecfb-4df2-a4a0-05cdd34f57e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:03 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Volume 9cb3c920-48ff-483d-8c95-51ff7db668c0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9cb3c920-48ff-483d-8c95-51ff7db668c0', 'volume_size': 1, 'snapshot_id': '696614f3-4d47-4fd8-8989-6eaf08220cd6'} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "cinder-quobyte-696614f3-4d47-4fd8-8989-6eaf08220cd6-9cb3c920-48ff-483d-8c95-51ff7db668c0" by "_create_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-696614f3-4d47-4fd8-8989-6eaf08220cd6-9cb3c920-48ff-483d-8c95-51ff7db668c0" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Creating volume 9cb3c920-48ff-483d-8c95-51ff7db668c0 from snapshot 696614f3-4d47-4fd8-8989-6eaf08220cd6 {{(pid=82038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "cinder-quobyte-9cb3c920-48ff-483d-8c95-51ff7db668c0" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-9cb3c920-48ff-483d-8c95-51ff7db668c0" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] snapshot: 696614f3-4d47-4fd8-8989-6eaf08220cd6, volume: 9cb3c920-48ff-483d-8c95-51ff7db668c0, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c7a7b2-5abb-4845-84d2-bafcd2c768ec]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:03 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 Apr 10 10:42:03 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:03 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6" returned: 0 in 0.598s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9084bc78-0228-4522-ab3b-ebf59d9d73c8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:04 devstack sudo[89003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 Apr 10 10:42:04 devstack sudo[89003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:04 devstack sudo[89003]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" returned: 0 in 0.524s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:04 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:42:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:04 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 Apr 10 10:42:04 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:06 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0" returned: 0 in 2.000s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:06 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3222a591-1ff3-43fb-8a24-613a36d657e4]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:06 devstack sudo[89021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 Apr 10 10:42:06 devstack sudo[89021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:07 devstack sudo[89021]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" returned: 0 in 0.584s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6, size 1024.00 MB, duration 2.00 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:42:07 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Converted 1024.00 MB image at 511.69 MB/s Apr 10 10:42:07 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 is being set with open permissions: ugo+rw Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:07 devstack sudo[89026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 Apr 10 10:42:07 devstack sudo[89026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:07 devstack sudo[89026]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0" returned: 0 in 0.391s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-9cb3c920-48ff-483d-8c95-51ff7db668c0" released by "_copy_volume_from_snapshot" :: held 4.160s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-696614f3-4d47-4fd8-8989-6eaf08220cd6-9cb3c920-48ff-483d-8c95-51ff7db668c0" released by "_create_volume_from_snapshot" :: held 4.182s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.193s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.620s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Creating offline snapshot e40871ee-0fdf-4d82-8f36-c6e8e94bb138 of volume 2a816486-caf4-4317-8ab7-dcaa97fc0c81 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf780ce-9651-43a4-9384-92ecf6434d94]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b264063b-ecfb-4df2-a4a0-05cdd34f57e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb3c920-48ff-483d-8c95-51ff7db668c0', 'volume_size': 1, 'snapshot_id': '696614f3-4d47-4fd8-8989-6eaf08220cd6'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbc7c60-b83e-4e45-b430-68a00a3b1c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:07 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Volume volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 (9cb3c920-48ff-483d-8c95-51ff7db668c0): created successfully Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cbc7c60-b83e-4e45-b430-68a00a3b1c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Flow 'volume_create_manager' (cd1054fe-cd7f-4cec-9c1d-a4b9446a288f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:07 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c001052c-6597-419b-9397-19bacab158f3 tempest-SnapshotDependencyTests-759796196 None] Created volume successfully. Apr 10 10:42:07 devstack sudo[89029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 Apr 10 10:42:07 devstack sudo[89029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:07 devstack sudo[89029]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81" returned: 0 in 0.453s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:07 devstack sudo[89034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 1G Apr 10 10:42:07 devstack sudo[89034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:08 devstack sudo[89034]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 1G" returned: 0 in 0.468s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:08 devstack sudo[89039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 Apr 10 10:42:08 devstack sudo[89039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "cinder-696614f3-4d47-4fd8-8989-6eaf08220cd6-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-696614f3-4d47-4fd8-8989-6eaf08220cd6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "cinder-quobyte-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "cinder-quobyte-696614f3-4d47-4fd8-8989-6eaf08220cd6" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-696614f3-4d47-4fd8-8989-6eaf08220cd6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Deleting offline snapshot 696614f3-4d47-4fd8-8989-6eaf08220cd6 of volume e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] snapshot_file for this snap is: volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2fe2c2-dbd1-4183-a038-9a4885ae7c8e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:08 devstack sudo[89041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 Apr 10 10:42:08 devstack sudo[89041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:08 devstack sudo[89039]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138" returned: 0 in 0.471s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:08 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 is being set with open permissions: ugo+rw Apr 10 10:42:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:08 devstack sudo[89046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 Apr 10 10:42:08 devstack sudo[89046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:09 devstack sudo[89041]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6" returned: 0 in 0.486s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e53e46-a4fd-442d-98cb-600540ac315f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:09 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 Apr 10 10:42:09 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:09 devstack sudo[89046]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138" returned: 0 in 0.400s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=95,cinder:DELETE=10,cinder:UPDATE=100,cinder:INSERT=28 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:UPDATE=112,cinder:INSERT=34,cinder:SELECT=80,cinder:DELETE=10 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:09 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.info Apr 10 10:42:09 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:09 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" returned: 0 in 0.471s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:09 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 Apr 10 10:42:09 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:09 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.info" returned: 0 in 0.416s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:09 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.info is being set with open permissions: ugo+rw Apr 10 10:42:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:09 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.info Apr 10 10:42:09 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:10 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6" returned: 0 in 0.476s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:10 devstack sudo[89068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6 Apr 10 10:42:10 devstack sudo[89068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:10 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.info" returned: 0 in 0.423s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.699s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:10 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-32e72ab3-780b-4f00-9705-d4f78eedf5b4 tempest-VolumesSnapshotTestJSON-1817325069 None] Create snapshot completed successfully Apr 10 10:42:10 devstack sudo[89068]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6.696614f3-4d47-4fd8-8989-6eaf08220cd6" returned: 0 in 0.410s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-696614f3-4d47-4fd8-8989-6eaf08220cd6" released by "_delete_snapshot" :: held 1.893s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" released by "delete_snapshot" :: held 1.904s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Created reservations ['6410c946-f49e-4f0a-b107-32a67cc312e6', 'ca25600d-ed81-4e5d-b782-68c3b83787c1', '18a7b13c-9a56-4fe9-bc3f-ff0320a4f886', 'de0af01a-7ae0-4b3e-8047-060b7d765d01'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:10 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Delete snapshot completed successfully. Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-54f8390d-2b5e-4229-8b4a-025d9632c616 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-696614f3-4d47-4fd8-8989-6eaf08220cd6-delete_snapshot" released by "delete_snapshot" :: held 1.989s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "cinder-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "cinder-quobyte-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f5e5bc-e89a-4e66-8c45-5974ca97f5ef]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:10 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 Apr 10 10:42:10 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-e40871ee-0fdf-4d82-8f36-c6e8e94bb138-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-e40871ee-0fdf-4d82-8f36-c6e8e94bb138-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:11 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" returned: 0 in 0.483s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:11 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6 Apr 10 10:42:11 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-2a816486-caf4-4317-8ab7-dcaa97fc0c81" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-2a816486-caf4-4317-8ab7-dcaa97fc0c81" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-e40871ee-0fdf-4d82-8f36-c6e8e94bb138" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-e40871ee-0fdf-4d82-8f36-c6e8e94bb138" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Deleting offline snapshot e40871ee-0fdf-4d82-8f36-c6e8e94bb138 of volume 2a816486-caf4-4317-8ab7-dcaa97fc0c81 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] snapshot_file for this snap is: volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6728b29f-b31e-4fcc-b5d0-e636c3f1cf76]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:11 devstack sudo[89078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 Apr 10 10:42:11 devstack sudo[89078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:11 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" returned: 0 in 0.408s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6" released by "delete_volume" :: held 0.917s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Created reservations ['26284942-b161-4630-93bc-60167406bcff', 'fb50a585-14f7-4e3b-b494-3d88e9130714', '5b33e24d-3bd4-4c5e-95b2-a89aea1122dc', 'cc2d0aa8-a66a-4a1f-a26f-2caec17c4c83'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:11 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:42:11 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:11 devstack sudo[89078]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138" returned: 0 in 0.487s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a30118-8e8e-47c8-9564-a2b34f2ae1ec]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "cinder-9cb3c920-48ff-483d-8c95-51ff7db668c0-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-9cb3c920-48ff-483d-8c95-51ff7db668c0-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "cinder-quobyte-9cb3c920-48ff-483d-8c95-51ff7db668c0" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-9cb3c920-48ff-483d-8c95-51ff7db668c0" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f5dc4f-6001-4ac9-976c-02f0b1da43f8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:11 devstack sudo[89086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 Apr 10 10:42:11 devstack sudo[89086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:12 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 Apr 10 10:42:12 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:12 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.509s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:12 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Deleted volume successfully. Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e652a011-c18e-43f4-bf37-a2894b319767 tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-e5a38af3-5d65-4abc-b1f1-3d7a758dbbb6-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:12 devstack sudo[89086]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81" returned: 0 in 0.490s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:12 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 Apr 10 10:42:12 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:12 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0" returned: 0 in 0.524s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:12 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0 Apr 10 10:42:12 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:12 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138" returned: 0 in 0.514s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:12 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9cb3c920-48ff-483d-8c95-51ff7db668c0" returned: 0 in 0.423s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-quobyte-9cb3c920-48ff-483d-8c95-51ff7db668c0" released by "delete_volume" :: held 0.972s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:12 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138 Apr 10 10:42:12 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Created reservations ['b053a0c1-0c85-4f36-b1a4-b9ea1c859dfc', '9f204b54-e952-4b66-87c0-281fde95c492', '8193644e-f4b1-4f7e-970c-58f51c8e7df6', '190ad616-affe-4d27-81db-caca19dc303a'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:13 devstack sudo[89108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:42:13 devstack sudo[89108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:13 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81.e40871ee-0fdf-4d82-8f36-c6e8e94bb138" returned: 0 in 0.533s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-e40871ee-0fdf-4d82-8f36-c6e8e94bb138" released by "_delete_snapshot" :: held 2.085s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-2a816486-caf4-4317-8ab7-dcaa97fc0c81" released by "delete_snapshot" :: held 2.101s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:13 devstack sudo[89108]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.502s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:13 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:13 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Deleted volume successfully. Apr 10 10:42:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-316b5e00-e197-4efe-b760-c20f8333e83d tempest-SnapshotDependencyTests-759796196 None] Lock "cinder-9cb3c920-48ff-483d-8c95-51ff7db668c0-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:13 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Created reservations ['2fab7f1c-6346-440c-92e7-02d3aa0905b8', 'd5285696-5aff-49d1-8cb7-614779dce69c', '35ac87d3-515b-4e02-af37-80daa7fe6d59', 'b3e07b07-3614-4a6a-9c91-df91fe4aea69'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:13 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Delete snapshot completed successfully. Apr 10 10:42:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a172a53e-74f6-4f97-b876-32d9a5b932ee tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-e40871ee-0fdf-4d82-8f36-c6e8e94bb138-delete_snapshot" released by "delete_snapshot" :: held 2.270s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Flow 'volume_create_manager' (8e6b7e7b-dc34-4ff0-8ad8-bcd17da75893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54934836-13f1-4791-bcee-89cae6597353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54934836-13f1-4791-bcee-89cae6597353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1829622923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6241f7f-2027-42af-b500-6fabec3314f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41753d0d302467b853d9d9fcef70397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:15Z,use_quota=True,user_id='a7fe68217adb4861aa3da63790e05915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81d916f-83a4-4552-a46f-43fb6b64a2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81d916f-83a4-4552-a46f-43fb6b64a2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730978ce-00c2-40d5-8cb4-0d020ec77d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (730978ce-00c2-40d5-8cb4-0d020ec77d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6241f7f-2027-42af-b500-6fabec3314f5', 'volume_name': 'volume-b6241f7f-2027-42af-b500-6fabec3314f5', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf4d575-2661-4b3b-9605-7a42a1a2fabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf4d575-2661-4b3b-9605-7a42a1a2fabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bac54d0-c381-4d34-acb8-ed7be2482c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:14 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume b6241f7f-2027-42af-b500-6fabec3314f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6241f7f-2027-42af-b500-6fabec3314f5', 'volume_size': 1} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1829622923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6241f7f-2027-42af-b500-6fabec3314f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41753d0d302467b853d9d9fcef70397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:15Z,use_quota=True,user_id='a7fe68217adb4861aa3da63790e05915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Creating volume b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:14 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:42:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:14 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 1073741824 Apr 10 10:42:14 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:15 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 1073741824" returned: 0 in 0.539s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:15 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 Apr 10 10:42:15 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:15 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5" returned: 0 in 0.454s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bac54d0-c381-4d34-acb8-ed7be2482c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6241f7f-2027-42af-b500-6fabec3314f5', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d6651c-0821-4dcd-8e8a-093c02694468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:15 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume volume-b6241f7f-2027-42af-b500-6fabec3314f5 (b6241f7f-2027-42af-b500-6fabec3314f5): created successfully Apr 10 10:42:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62d6651c-0821-4dcd-8e8a-093c02694468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Flow 'volume_create_manager' (8e6b7e7b-dc34-4ff0-8ad8-bcd17da75893) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:15 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e0d6eae5-2b8d-4646-a194-a365c6e3c666 tempest-VolumesSnapshotTestJSON-1817325069 None] Created volume successfully. Apr 10 10:42:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Creating offline snapshot 110b2572-0f46-4be2-9660-53422debbcdd of volume b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:42:17 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a18426c-cfe9-43d0-a2e5-aeef92e4a406]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:17 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 Apr 10 10:42:17 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:17 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5" returned: 0 in 0.512s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:17 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd 1G Apr 10 10:42:17 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:18 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd 1G" returned: 0 in 0.547s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6241f7f-2027-42af-b500-6fabec3314f5 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:18 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6241f7f-2027-42af-b500-6fabec3314f5 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd Apr 10 10:42:18 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:18 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6241f7f-2027-42af-b500-6fabec3314f5 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd" returned: 0 in 0.497s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:18 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd is being set with open permissions: ugo+rw Apr 10 10:42:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:18 devstack sudo[89139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd Apr 10 10:42:18 devstack sudo[89139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:19 devstack sudo[89139]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd" returned: 0 in 0.463s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:19 devstack sudo[89142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.info Apr 10 10:42:19 devstack sudo[89142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:19 devstack sudo[89142]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.info" returned: 0 in 0.464s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:19 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.info is being set with open permissions: ugo+rw Apr 10 10:42:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:19 devstack sudo[89145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.info Apr 10 10:42:19 devstack sudo[89145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:20 devstack sudo[89145]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.info" returned: 0 in 0.449s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.997s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:20 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-36e08a67-0f71-403d-a2f2-d8b7d24596c9 tempest-VolumesSnapshotTestJSON-1817325069 None] Create snapshot completed successfully Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Flow 'volume_create_manager' (300e52e5-c3c2-452c-9a0d-55d1ff3def5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c42429-85a0-4efd-b00f-b554567bbbef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67c42429-85a0-4efd-b00f-b554567bbbef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-986683863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fa5e1b-dce5-4dad-bc7a-54a15fb65870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41753d0d302467b853d9d9fcef70397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=110b2572-0f46-4be2-9660-53422debbcdd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:20Z,use_quota=True,user_id='a7fe68217adb4861aa3da63790e05915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7c8cc4-d52c-49eb-93bf-00473b63098e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7c8cc4-d52c-49eb-93bf-00473b63098e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa8cf29-483b-4fbf-b91d-da29fd07324f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa8cf29-483b-4fbf-b91d-da29fd07324f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '88fa5e1b-dce5-4dad-bc7a-54a15fb65870', 'volume_name': 'volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870', 'volume_size': 2, 'snapshot_id': '110b2572-0f46-4be2-9660-53422debbcdd'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52b1735-b793-4c79-ba45-8f8ae88d8897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c52b1735-b793-4c79-ba45-8f8ae88d8897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2b16e9-353d-469b-bef8-8cb4d5491277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:20 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume 88fa5e1b-dce5-4dad-bc7a-54a15fb65870: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870', 'volume_size': 2, 'snapshot_id': '110b2572-0f46-4be2-9660-53422debbcdd'} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-110b2572-0f46-4be2-9660-53422debbcdd-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" by "_create_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-110b2572-0f46-4be2-9660-53422debbcdd-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Creating volume 88fa5e1b-dce5-4dad-bc7a-54a15fb65870 from snapshot 110b2572-0f46-4be2-9660-53422debbcdd {{(pid=82038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] snapshot: 110b2572-0f46-4be2-9660-53422debbcdd, volume: 88fa5e1b-dce5-4dad-bc7a-54a15fb65870, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3138d424-f7c5-42e6-aa24-5a7815b8bc03]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:20 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd Apr 10 10:42:20 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:21 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd" returned: 0 in 0.518s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6241f7f-2027-42af-b500-6fabec3314f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:42:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:42:21 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb7200-574a-4b6c-822b-366929ca9b5c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:21 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 Apr 10 10:42:21 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:21 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5" returned: 0 in 0.459s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:21 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:42:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:21 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 Apr 10 10:42:21 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:23 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" returned: 0 in 1.952s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:23 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab42903-e3b5-4488-b363-4dd10fbed858]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:23 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 Apr 10 10:42:23 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:24 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5" returned: 0 in 0.650s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5, size 1024.00 MB, duration 1.95 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:42:24 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Converted 1024.00 MB image at 524.26 MB/s Apr 10 10:42:24 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 is being set with open permissions: ugo+rw Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:24 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 Apr 10 10:42:24 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:24 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" returned: 0 in 0.383s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" released by "_copy_volume_from_snapshot" :: held 4.019s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-110b2572-0f46-4be2-9660-53422debbcdd-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" released by "_create_volume_from_snapshot" :: held 4.040s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.050s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b2b16e9-353d-469b-bef8-8cb4d5491277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870', 'volume_size': 2, 'snapshot_id': '110b2572-0f46-4be2-9660-53422debbcdd'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec727883-9da0-4c6d-a5a7-e62e12074128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:24 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 (88fa5e1b-dce5-4dad-bc7a-54a15fb65870): created successfully Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec727883-9da0-4c6d-a5a7-e62e12074128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Flow 'volume_create_manager' (300e52e5-c3c2-452c-9a0d-55d1ff3def5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:24 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-626b5d31-9e99-42ca-8753-a22e5938ba98 tempest-VolumesSnapshotTestJSON-1817325069 None] Created volume successfully. Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-88fa5e1b-dce5-4dad-bc7a-54a15fb65870-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-88fa5e1b-dce5-4dad-bc7a-54a15fb65870-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[524435a2-433b-45e3-bd2a-54e229d5b063]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:24 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 Apr 10 10:42:24 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:25 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" returned: 0 in 0.434s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:25 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870 Apr 10 10:42:25 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:25 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" returned: 0 in 0.391s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-88fa5e1b-dce5-4dad-bc7a-54a15fb65870" released by "delete_volume" :: held 0.856s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Created reservations ['707fcc9f-3f2f-45ee-b8ce-171116fdf7cf', 'ebf5c3b3-ff12-4214-9711-03939ab6a8ce', '0a7f1d08-a519-49f5-88a0-cacce65c8171', 'ac6b813f-0ca3-468c-8dc3-a5fd8ee130f9'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:25 devstack sudo[89187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:42:25 devstack sudo[89187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-110b2572-0f46-4be2-9660-53422debbcdd-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-110b2572-0f46-4be2-9660-53422debbcdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-b6241f7f-2027-42af-b500-6fabec3314f5" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-b6241f7f-2027-42af-b500-6fabec3314f5" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-110b2572-0f46-4be2-9660-53422debbcdd" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-110b2572-0f46-4be2-9660-53422debbcdd" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Deleting offline snapshot 110b2572-0f46-4be2-9660-53422debbcdd of volume b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] snapshot_file for this snap is: volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e885b8ab-3738-4e78-a810-2d223dacdda5]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:26 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd Apr 10 10:42:26 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:26 devstack sudo[89187]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.497s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:26 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:26 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Deleted volume successfully. Apr 10 10:42:26 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d05e962f-cef8-49a9-ad13-9e9b863e85f2 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-88fa5e1b-dce5-4dad-bc7a-54a15fb65870-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:26 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd" returned: 0 in 0.506s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6241f7f-2027-42af-b500-6fabec3314f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:26 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1417ce4b-3b27-48ec-961d-be0c69db2803]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:26 devstack sudo[89195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 Apr 10 10:42:26 devstack sudo[89195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:27 devstack sudo[89195]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5" returned: 0 in 0.556s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:27 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd Apr 10 10:42:27 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:27 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd" returned: 0 in 0.450s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:27 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd Apr 10 10:42:27 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:27 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5.110b2572-0f46-4be2-9660-53422debbcdd" returned: 0 in 0.473s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:27 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-110b2572-0f46-4be2-9660-53422debbcdd" released by "_delete_snapshot" :: held 2.041s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:27 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-b6241f7f-2027-42af-b500-6fabec3314f5" released by "delete_snapshot" :: held 2.055s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:28 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Created reservations ['aa8e01a1-2323-4997-b647-79c4c45e8384', '36760d69-fc6e-419d-8889-eb7582c51ade', '465f870f-6786-43e3-8d23-be982fde499d', '3cf7752a-8218-4242-b91c-b980afe7dae0'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:28 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Delete snapshot completed successfully. Apr 10 10:42:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a2cdfabe-337f-4a34-8f8f-80755ff436aa tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-110b2572-0f46-4be2-9660-53422debbcdd-delete_snapshot" released by "delete_snapshot" :: held 2.135s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-b6241f7f-2027-42af-b500-6fabec3314f5-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-b6241f7f-2027-42af-b500-6fabec3314f5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-b6241f7f-2027-42af-b500-6fabec3314f5" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-b6241f7f-2027-42af-b500-6fabec3314f5" acquired by "delete_volume" :: waited 0.007s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:29 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[132755fb-9401-4375-8bc6-8168cae2c78e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:29 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 Apr 10 10:42:29 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:29 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5" returned: 0 in 0.492s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:29 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5 Apr 10 10:42:29 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:30 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b6241f7f-2027-42af-b500-6fabec3314f5" returned: 0 in 0.421s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-b6241f7f-2027-42af-b500-6fabec3314f5" released by "delete_volume" :: held 0.952s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Created reservations ['507e617a-c726-46a3-ab93-6902d841f9e2', '0d6eeabe-74ac-4ec7-aff6-1610f912eabf', '5617f77a-b27a-4198-8e7d-77aa55c6d747', '76ade1a5-74c7-4e7f-897d-98d4d3c545b4'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:30 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:42:30 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Flow 'volume_create_manager' (d9cfbcbc-bebd-48eb-b897-a2b9ac94b385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569151bc-6477-45d7-b7bb-c8feea7b46a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (569151bc-6477-45d7-b7bb-c8feea7b46a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1832312648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b716f7-42d2-4b80-813c-b178bbd470e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41753d0d302467b853d9d9fcef70397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:30Z,use_quota=True,user_id='a7fe68217adb4861aa3da63790e05915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4fbe6a1-1851-40a9-a1cd-9a5b5633e6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4fbe6a1-1851-40a9-a1cd-9a5b5633e6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25fd1ef-e1ec-4651-9d14-25a90ad88e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c25fd1ef-e1ec-4651-9d14-25a90ad88e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83b716f7-42d2-4b80-813c-b178bbd470e3', 'volume_name': 'volume-83b716f7-42d2-4b80-813c-b178bbd470e3', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54131e72-62f3-42a4-a881-afef01abef33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54131e72-62f3-42a4-a881-afef01abef33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f702304-1fa5-413c-af75-fe0b4fd30ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:30 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume 83b716f7-42d2-4b80-813c-b178bbd470e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83b716f7-42d2-4b80-813c-b178bbd470e3', 'volume_size': 1} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1832312648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83b716f7-42d2-4b80-813c-b178bbd470e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41753d0d302467b853d9d9fcef70397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:30Z,use_quota=True,user_id='a7fe68217adb4861aa3da63790e05915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Creating volume 83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:30 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:30 devstack sudo[89219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 1073741824 Apr 10 10:42:30 devstack sudo[89219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:30 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.460s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:30 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Deleted volume successfully. Apr 10 10:42:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-192f6a63-bb6f-46e0-be0e-20dfa3a75881 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-b6241f7f-2027-42af-b500-6fabec3314f5-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:31 devstack sudo[89219]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 1073741824" returned: 0 in 0.498s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:31 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 Apr 10 10:42:31 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:31 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3" returned: 0 in 0.417s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f702304-1fa5-413c-af75-fe0b4fd30ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83b716f7-42d2-4b80-813c-b178bbd470e3', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d5d081-d50a-441e-af74-14ac3080ff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:31 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Volume volume-83b716f7-42d2-4b80-813c-b178bbd470e3 (83b716f7-42d2-4b80-813c-b178bbd470e3): created successfully Apr 10 10:42:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41d5d081-d50a-441e-af74-14ac3080ff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Flow 'volume_create_manager' (d9cfbcbc-bebd-48eb-b897-a2b9ac94b385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:31 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c57c759f-e395-452b-880f-c3368e814a11 tempest-VolumesSnapshotTestJSON-1817325069 None] Created volume successfully. Apr 10 10:42:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Creating offline snapshot 7193d2d3-1a2d-468e-b28c-07a159129b1c of volume 83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:42:32 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9efdbd-212a-43bf-abe8-debe3446d817]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:32 devstack sudo[89228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 Apr 10 10:42:32 devstack sudo[89228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:33 devstack sudo[89228]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3" returned: 0 in 0.453s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:33 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c 1G Apr 10 10:42:33 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:33 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c 1G" returned: 0 in 0.447s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b716f7-42d2-4b80-813c-b178bbd470e3 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:33 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b716f7-42d2-4b80-813c-b178bbd470e3 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c Apr 10 10:42:33 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:34 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83b716f7-42d2-4b80-813c-b178bbd470e3 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c" returned: 0 in 0.423s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:34 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c is being set with open permissions: ugo+rw Apr 10 10:42:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:34 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c Apr 10 10:42:34 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:34 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c" returned: 0 in 0.397s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:34 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.info Apr 10 10:42:34 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:34 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.info" returned: 0 in 0.415s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:34 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.info is being set with open permissions: ugo+rw Apr 10 10:42:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:34 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.info Apr 10 10:42:34 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:35 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.info" returned: 0 in 0.400s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:35 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-8fd8918f-8cdb-47a9-8ed0-7abab5f706a3 tempest-VolumesSnapshotTestJSON-1817325069 None] Create snapshot completed successfully Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Flow 'volume_create_manager' (204d47fd-9d2c-4a7d-912e-7011a0550dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe1f764-5675-4740-89a7-cef3cb65c891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebe1f764-5675-4740-89a7-cef3cb65c891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1068620193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16d64322-b06d-461c-9f73-8c8b0956ad1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a41753d0d302467b853d9d9fcef70397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7193d2d3-1a2d-468e-b28c-07a159129b1c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:36Z,use_quota=True,user_id='a7fe68217adb4861aa3da63790e05915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175faa45-a94d-40aa-82e7-2c5eae87d27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (175faa45-a94d-40aa-82e7-2c5eae87d27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbee5cf-8467-4e91-97c7-08af2697d91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbee5cf-8467-4e91-97c7-08af2697d91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16d64322-b06d-461c-9f73-8c8b0956ad1d', 'volume_name': 'volume-16d64322-b06d-461c-9f73-8c8b0956ad1d', 'volume_size': 1, 'snapshot_id': '7193d2d3-1a2d-468e-b28c-07a159129b1c'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0d469b-36ae-47db-b8a7-d7bd904555d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c0d469b-36ae-47db-b8a7-d7bd904555d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12b012b-976d-488a-a2bc-00e3d19c3049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:36 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Volume 16d64322-b06d-461c-9f73-8c8b0956ad1d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16d64322-b06d-461c-9f73-8c8b0956ad1d', 'volume_size': 1, 'snapshot_id': '7193d2d3-1a2d-468e-b28c-07a159129b1c'} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-7193d2d3-1a2d-468e-b28c-07a159129b1c-16d64322-b06d-461c-9f73-8c8b0956ad1d" by "_create_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-7193d2d3-1a2d-468e-b28c-07a159129b1c-16d64322-b06d-461c-9f73-8c8b0956ad1d" acquired by "_create_volume_from_snapshot" :: waited 0.006s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Creating volume 16d64322-b06d-461c-9f73-8c8b0956ad1d from snapshot 7193d2d3-1a2d-468e-b28c-07a159129b1c {{(pid=82038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-16d64322-b06d-461c-9f73-8c8b0956ad1d" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-16d64322-b06d-461c-9f73-8c8b0956ad1d" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] snapshot: 7193d2d3-1a2d-468e-b28c-07a159129b1c, volume: 16d64322-b06d-461c-9f73-8c8b0956ad1d, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2feecb9-6202-4ead-8bb9-cbac87f75b89]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:36 devstack sudo[89252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c Apr 10 10:42:36 devstack sudo[89252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:36 devstack sudo[89252]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c" returned: 0 in 0.461s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83b716f7-42d2-4b80-813c-b178bbd470e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68c724d-bcbc-4cd9-8e36-43d40996fe03]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:36 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 Apr 10 10:42:36 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:37 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3" returned: 0 in 0.476s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:37 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:42:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:37 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d Apr 10 10:42:37 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:38 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d" returned: 0 in 1.785s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:38 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[767f5a09-5b7a-4abb-9ef2-0239cf188709]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:39 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 Apr 10 10:42:39 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:39 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:42:39 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:39 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3" returned: 0 in 0.591s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3, size 1024.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:42:39 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Converted 1024.00 MB image at 573.41 MB/s Apr 10 10:42:39 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d is being set with open permissions: ugo+rw Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:39 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d Apr 10 10:42:39 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:39 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.431s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:39 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d" returned: 0 in 0.402s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-16d64322-b06d-461c-9f73-8c8b0956ad1d" released by "_copy_volume_from_snapshot" :: held 3.772s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-7193d2d3-1a2d-468e-b28c-07a159129b1c-16d64322-b06d-461c-9f73-8c8b0956ad1d" released by "_create_volume_from_snapshot" :: held 3.789s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.797s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d12b012b-976d-488a-a2bc-00e3d19c3049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16d64322-b06d-461c-9f73-8c8b0956ad1d', 'volume_size': 1, 'snapshot_id': '7193d2d3-1a2d-468e-b28c-07a159129b1c'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:39 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6cff11-7537-41d7-a8f5-7effc72442fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:40 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Volume volume-16d64322-b06d-461c-9f73-8c8b0956ad1d (16d64322-b06d-461c-9f73-8c8b0956ad1d): created successfully Apr 10 10:42:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed6cff11-7537-41d7-a8f5-7effc72442fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Flow 'volume_create_manager' (204d47fd-9d2c-4a7d-912e-7011a0550dbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:40 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-92feb38e-0d1f-4d52-9683-9d69220116ff tempest-VolumesSnapshotTestJSON-1817325069 None] Created volume successfully. Apr 10 10:42:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-16d64322-b06d-461c-9f73-8c8b0956ad1d-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-16d64322-b06d-461c-9f73-8c8b0956ad1d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-16d64322-b06d-461c-9f73-8c8b0956ad1d" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-16d64322-b06d-461c-9f73-8c8b0956ad1d" acquired by "delete_volume" :: waited 0.007s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:40 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40ed8b9-6e1c-44c1-83d7-58fa2a56844f]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:40 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d Apr 10 10:42:40 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:40 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d" returned: 0 in 0.463s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:40 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d Apr 10 10:42:40 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:41 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-16d64322-b06d-461c-9f73-8c8b0956ad1d" returned: 0 in 0.404s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-16d64322-b06d-461c-9f73-8c8b0956ad1d" released by "delete_volume" :: held 0.889s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Created reservations ['0019cbcf-2153-4b11-a390-c441186df7f4', 'a5f113d8-a307-4093-982c-2666ae5209d4', 'c7785ebc-daac-4ed5-b3cb-68263ff0f86d', 'e773ce73-1cd5-4ef6-8b7e-467fb71665e8'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:41 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:42:41 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-7193d2d3-1a2d-468e-b28c-07a159129b1c-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-7193d2d3-1a2d-468e-b28c-07a159129b1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-83b716f7-42d2-4b80-813c-b178bbd470e3" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-83b716f7-42d2-4b80-813c-b178bbd470e3" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-7193d2d3-1a2d-468e-b28c-07a159129b1c" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-7193d2d3-1a2d-468e-b28c-07a159129b1c" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Deleting offline snapshot 7193d2d3-1a2d-468e-b28c-07a159129b1c of volume 83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] snapshot_file for this snap is: volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb74bd47-d351-4fcd-b999-a870d34837cd]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:41 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c Apr 10 10:42:41 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:41 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.443s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:41 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Deleted volume successfully. Apr 10 10:42:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e9a54c6f-f209-4213-bfdb-e0dbba908e79 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-16d64322-b06d-461c-9f73-8c8b0956ad1d-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:42 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c" returned: 0 in 0.487s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83b716f7-42d2-4b80-813c-b178bbd470e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:42:42 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[585d1d20-d667-43f1-b8ac-773e77fa54bc]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:42 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 Apr 10 10:42:42 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:42 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3" returned: 0 in 0.463s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:42 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c Apr 10 10:42:42 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:42 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c" returned: 0 in 0.428s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:43 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c Apr 10 10:42:43 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:43 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3.7193d2d3-1a2d-468e-b28c-07a159129b1c" returned: 0 in 0.381s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-7193d2d3-1a2d-468e-b28c-07a159129b1c" released by "_delete_snapshot" :: held 1.813s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-83b716f7-42d2-4b80-813c-b178bbd470e3" released by "delete_snapshot" :: held 1.830s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Created reservations ['9dbb54a2-890a-45b3-8ecf-d937c1c9b3c3', '1cfba2f4-83fa-414b-a961-302414270d8f', '0b9f0c50-bb6a-4775-92c2-07b878cfef09', '55bc2422-ec25-4c6e-9c6d-93be07d51828'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:43 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Delete snapshot completed successfully. Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e49f9f5f-54b9-4262-96f0-c26d12dbed12 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-7193d2d3-1a2d-468e-b28c-07a159129b1c-delete_snapshot" released by "delete_snapshot" :: held 1.911s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-83b716f7-42d2-4b80-813c-b178bbd470e3-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-83b716f7-42d2-4b80-813c-b178bbd470e3-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-83b716f7-42d2-4b80-813c-b178bbd470e3" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-83b716f7-42d2-4b80-813c-b178bbd470e3" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d48a19f-0f9d-4b03-b92d-feee4c16b57e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:43 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 Apr 10 10:42:43 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:44 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3" returned: 0 in 0.450s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:44 devstack sudo[89320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3 Apr 10 10:42:44 devstack sudo[89320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:44 devstack sudo[89320]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-83b716f7-42d2-4b80-813c-b178bbd470e3" returned: 0 in 0.390s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-83b716f7-42d2-4b80-813c-b178bbd470e3" released by "delete_volume" :: held 0.870s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Created reservations ['a7fbea0c-fbd7-42fc-a170-5258f7b801cf', '5ca33788-f6b9-429a-a4ca-115440deec49', 'eab98942-41a8-465d-b7a3-5fc71a48b61f', '99336c09-8a5f-41b7-91c7-383ac7410427'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:44 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:42:44 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-2a816486-caf4-4317-8ab7-dcaa97fc0c81-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-2a816486-caf4-4317-8ab7-dcaa97fc0c81-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "cinder-quobyte-2a816486-caf4-4317-8ab7-dcaa97fc0c81" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-2a816486-caf4-4317-8ab7-dcaa97fc0c81" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23c26c5-0566-4642-ac1c-f44a20969782]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:45 devstack sudo[89325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 Apr 10 10:42:45 devstack sudo[89325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:45 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.436s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:45 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Deleted volume successfully. Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4a6c257a-8664-4b63-a1e3-c9021c1b926c tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-83b716f7-42d2-4b80-813c-b178bbd470e3-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:45 devstack sudo[89325]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81" returned: 0 in 0.484s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:45 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81 Apr 10 10:42:45 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:45 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a816486-caf4-4317-8ab7-dcaa97fc0c81" returned: 0 in 0.387s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-quobyte-2a816486-caf4-4317-8ab7-dcaa97fc0c81" released by "delete_volume" :: held 0.896s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Created reservations ['58ae9ed8-13d2-4ab0-9cd2-c55592676da0', 'a7cd5d02-06af-4808-8f88-7b1da2d380dc', 'b9526f38-5391-40dc-9b33-b177889f04ab', 'a4fdd28e-d46f-47d3-b342-f3979ce3a44e'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:45 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:42:45 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:46 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.427s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:46 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:42:46 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Deleted volume successfully. Apr 10 10:42:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0cd12313-7566-4ad4-ab2b-19a580c6e949 tempest-VolumesSnapshotTestJSON-1817325069 None] Lock "cinder-2a816486-caf4-4317-8ab7-dcaa97fc0c81-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (cd5b6c67-e015-448f-a24a-eeb8787163c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a91c942-f2ce-4787-a42d-df9b00bd7103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a91c942-f2ce-4787-a42d-df9b00bd7103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962812163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8eee34-091f-4aee-98b3-c3226af3a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:50Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716485dc-d881-4037-beaf-124a424b0991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716485dc-d881-4037-beaf-124a424b0991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42444f43-9655-4e07-a342-1764481611ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42444f43-9655-4e07-a342-1764481611ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a8eee34-091f-4aee-98b3-c3226af3a4af', 'volume_name': 'volume-2a8eee34-091f-4aee-98b3-c3226af3a4af', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18496d2e-96d8-4217-a9b4-98efc3ac7565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18496d2e-96d8-4217-a9b4-98efc3ac7565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a725be23-40b7-4e8f-b903-e982790088f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:49 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume 2a8eee34-091f-4aee-98b3-c3226af3a4af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a8eee34-091f-4aee-98b3-c3226af3a4af', 'volume_size': 1} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1962812163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a8eee34-091f-4aee-98b3-c3226af3a4af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:50Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Creating volume 2a8eee34-091f-4aee-98b3-c3226af3a4af {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:49 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:42:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:49 devstack sudo[89346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af 1073741824 Apr 10 10:42:49 devstack sudo[89346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:50 devstack sudo[89346]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af 1073741824" returned: 0 in 0.460s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:50 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af Apr 10 10:42:50 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:50 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af" returned: 0 in 0.411s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a725be23-40b7-4e8f-b903-e982790088f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a8eee34-091f-4aee-98b3-c3226af3a4af', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8379d82c-011a-4153-90f8-65f8cc100e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:50 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume volume-2a8eee34-091f-4aee-98b3-c3226af3a4af (2a8eee34-091f-4aee-98b3-c3226af3a4af): created successfully Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8379d82c-011a-4153-90f8-65f8cc100e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (cd5b6c67-e015-448f-a24a-eeb8787163c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:50 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b969560a-828d-4dfb-a778-65be1f1e4ee5 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created volume successfully. Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Creating offline snapshot 7d98e175-7eac-46c7-a67b-840c5ab9b295 of volume 2a8eee34-091f-4aee-98b3-c3226af3a4af {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8e308b-2d15-42a1-9e37-916344897c87]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:50 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af Apr 10 10:42:50 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:51 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af" returned: 0 in 0.441s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:51 devstack sudo[89360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 1G Apr 10 10:42:51 devstack sudo[89360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:51 devstack sudo[89360]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 1G" returned: 0 in 0.443s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8eee34-091f-4aee-98b3-c3226af3a4af -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:51 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8eee34-091f-4aee-98b3-c3226af3a4af -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 Apr 10 10:42:51 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:52 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a8eee34-091f-4aee-98b3-c3226af3a4af -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295" returned: 0 in 0.441s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:52 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 is being set with open permissions: ugo+rw Apr 10 10:42:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:52 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 Apr 10 10:42:52 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:52 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295" returned: 0 in 0.397s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:52 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.info Apr 10 10:42:52 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:52 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.info" returned: 0 in 0.411s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:52 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.info is being set with open permissions: ugo+rw Apr 10 10:42:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:52 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.info Apr 10 10:42:52 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:53 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.info" returned: 0 in 0.384s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:53 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-673a4e16-4260-4a7f-960f-9bdc0a5a62e8 tempest-CreateVolumesFromSnapshotTest-532914684 None] Create snapshot completed successfully Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (f32063d4-0595-4cca-90f2-64a1fc003034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d62e796-fed9-43a5-b925-d4af1a2f8436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d62e796-fed9-43a5-b925-d4af1a2f8436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955825975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7b4b0a-d5aa-496b-8590-c711983ee36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:54Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee7ee0c-4c3d-4e00-aa1f-6d5568cb5eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ee7ee0c-4c3d-4e00-aa1f-6d5568cb5eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeb9a64-c052-4daf-a37b-dda6f5962d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfeb9a64-c052-4daf-a37b-dda6f5962d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf7b4b0a-d5aa-496b-8590-c711983ee36f', 'volume_name': 'volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e4709e-6383-4305-b661-dd0ff9d178b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84e4709e-6383-4305-b661-dd0ff9d178b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bea213-14d9-443c-bd65-1bd36d055ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume cf7b4b0a-d5aa-496b-8590-c711983ee36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f', 'volume_size': 1} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955825975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf7b4b0a-d5aa-496b-8590-c711983ee36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:54Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Creating volume cf7b4b0a-d5aa-496b-8590-c711983ee36f {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:54 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:54 devstack sudo[89380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f 1073741824 Apr 10 10:42:54 devstack sudo[89380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (3d8e7d06-7c88-479e-84a5-b8a5e3230cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e791b40a-04c0-4696-b7c8-29d3effe8f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e791b40a-04c0-4696-b7c8-29d3effe8f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1826893373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe20fff-5ea2-4306-9025-ba8c4f1ce781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:54Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da28d603-a754-44e7-9d1b-7e71d2c0ce4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da28d603-a754-44e7-9d1b-7e71d2c0ce4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb4de39-c081-4fa9-a9e0-783e6c165330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb4de39-c081-4fa9-a9e0-783e6c165330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fe20fff-5ea2-4306-9025-ba8c4f1ce781', 'volume_name': 'volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34385058-c6e3-4faf-a7c5-a9b092c80e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34385058-c6e3-4faf-a7c5-a9b092c80e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f5d045-5856-4edd-b2f8-2c530ad47ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume 8fe20fff-5ea2-4306-9025-ba8c4f1ce781: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781', 'volume_size': 1} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (6272e4c1-e61f-4f24-bb8c-2d44b6aa8619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a446fb4-2617-4660-bf00-76de3231c2c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a446fb4-2617-4660-bf00-76de3231c2c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521810160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:55Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09bac98a-1166-4c72-9121-397212694af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09bac98a-1166-4c72-9121-397212694af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de68e4a8-5a7d-46b5-9277-39fabb244a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de68e4a8-5a7d-46b5-9277-39fabb244a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5', 'volume_name': 'volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16bf1897-704e-439e-9182-0b16ad30f66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16bf1897-704e-439e-9182-0b16ad30f66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2915a21-bff4-418d-b8af-a8e37b750c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume 36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5', 'volume_size': 1} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (e7e89d93-cf29-4d7d-8d8d-696b5851dcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c321393a-7950-449a-98d5-35316c8fce06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c321393a-7950-449a-98d5-35316c8fce06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319997390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99831928-e718-4fd6-969b-85ebcdcd2179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:55Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b679659-0225-4866-885b-ee9938b90117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b679659-0225-4866-885b-ee9938b90117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc92604-af56-492f-be4f-4f845fa23bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc92604-af56-492f-be4f-4f845fa23bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99831928-e718-4fd6-969b-85ebcdcd2179', 'volume_name': 'volume-99831928-e718-4fd6-969b-85ebcdcd2179', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack sudo[89380]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d54859-6c71-4de6-b177-6fe25f8f3729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d54859-6c71-4de6-b177-6fe25f8f3729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b990414-966b-4ee0-9ab6-44e876ccdac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume 99831928-e718-4fd6-969b-85ebcdcd2179: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99831928-e718-4fd6-969b-85ebcdcd2179', 'volume_size': 1} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f 1073741824" returned: 0 in 0.612s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:54 devstack sudo[89385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f Apr 10 10:42:54 devstack sudo[89385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (925daa93-47a3-42ce-8285-fe3ce865bf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c27445d-c31a-452b-9eb4-f9b6e5e12b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c27445d-c31a-452b-9eb4-f9b6e5e12b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-569913462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88008e2-4446-49a9-9df6-44029c1085ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:55Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9362be15-ac26-469f-876f-c9374417d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9362be15-ac26-469f-876f-c9374417d67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f4e44c-dce3-4eb1-a8de-4f842aedae3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89f4e44c-dce3-4eb1-a8de-4f842aedae3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c88008e2-4446-49a9-9df6-44029c1085ff', 'volume_name': 'volume-c88008e2-4446-49a9-9df6-44029c1085ff', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a7bde-341e-4730-ae53-105801f61529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (328a7bde-341e-4730-ae53-105801f61529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc01d902-1bf1-4eeb-a8c8-02eec65ecf6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:54 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume c88008e2-4446-49a9-9df6-44029c1085ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c88008e2-4446-49a9-9df6-44029c1085ff', 'volume_size': 1} Apr 10 10:42:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:55 devstack sudo[89385]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f" returned: 0 in 0.419s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.866s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1826893373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fe20fff-5ea2-4306-9025-ba8c4f1ce781,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:54Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Creating volume 8fe20fff-5ea2-4306-9025-ba8c4f1ce781 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:55 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3bea213-14d9-443c-bd65-1bd36d055ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5faa5b51-688a-4142-aa43-36b5c7847c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:55 devstack sudo[89388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781 1073741824 Apr 10 10:42:55 devstack sudo[89388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:55 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f (cf7b4b0a-d5aa-496b-8590-c711983ee36f): created successfully Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5faa5b51-688a-4142-aa43-36b5c7847c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (f32063d4-0595-4cca-90f2-64a1fc003034) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:55 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-799dcc8f-e075-42ac-8b46-96b9a728e697 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created volume successfully. Apr 10 10:42:55 devstack sudo[89388]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781 1073741824" returned: 0 in 0.486s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:55 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781 Apr 10 10:42:55 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:56 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781" returned: 0 in 0.416s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.584s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-521810160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:55Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Creating volume 36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:56 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98f5d045-5856-4edd-b2f8-2c530ad47ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:56 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 1073741824 Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5f48af-4764-49d5-863f-88fe22ace929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:56 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:56 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781 (8fe20fff-5ea2-4306-9025-ba8c4f1ce781): created successfully Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be5f48af-4764-49d5-863f-88fe22ace929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (3d8e7d06-7c88-479e-84a5-b8a5e3230cea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:56 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-714b0464-a9a4-41c6-9da6-38ab7f975824 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created volume successfully. Apr 10 10:42:56 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 1073741824" returned: 0 in 0.461s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:56 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 Apr 10 10:42:56 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:57 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5" returned: 0 in 0.412s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.282s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1319997390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99831928-e718-4fd6-969b-85ebcdcd2179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:55Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Creating volume 99831928-e718-4fd6-969b-85ebcdcd2179 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:57 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2915a21-bff4-418d-b8af-a8e37b750c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8793721-10d9-412e-810c-50c3aac2b1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:57 devstack sudo[89404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179 1073741824 Apr 10 10:42:57 devstack sudo[89404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:57 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 (36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5): created successfully Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8793721-10d9-412e-810c-50c3aac2b1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (6272e4c1-e61f-4f24-bb8c-2d44b6aa8619) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:57 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-bb7366da-72b3-4b1a-9ad9-8f4d0a419324 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created volume successfully. Apr 10 10:42:57 devstack sudo[89404]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179 1073741824" returned: 0 in 0.487s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:57 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179 Apr 10 10:42:57 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:57 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179" returned: 0 in 0.381s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.998s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:42:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-569913462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c88008e2-4446-49a9-9df6-44029c1085ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f35152bfae50401e80d5c57e032f0b53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:42:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:42:55Z,use_quota=True,user_id='6e30845133414b648a18b22b3590d3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Creating volume c88008e2-4446-49a9-9df6-44029c1085ff {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:42:57 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:42:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b990414-966b-4ee0-9ab6-44e876ccdac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99831928-e718-4fd6-969b-85ebcdcd2179', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:58 devstack sudo[89412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff 1073741824 Apr 10 10:42:58 devstack sudo[89412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2316a388-dd58-4264-aaed-411e6afd0de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:58 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume volume-99831928-e718-4fd6-969b-85ebcdcd2179 (99831928-e718-4fd6-969b-85ebcdcd2179): created successfully Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2316a388-dd58-4264-aaed-411e6afd0de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (e7e89d93-cf29-4d7d-8d8d-696b5851dcc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:58 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-75039103-e50a-40a8-acf3-9bc59e6335c7 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created volume successfully. Apr 10 10:42:58 devstack sudo[89412]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff 1073741824" returned: 0 in 0.479s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:58 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff Apr 10 10:42:58 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:58 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff" returned: 0 in 0.392s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc01d902-1bf1-4eeb-a8c8-02eec65ecf6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c88008e2-4446-49a9-9df6-44029c1085ff', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d453a4c-6809-4d97-81bb-bfbd4e3633bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:42:58 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Volume volume-c88008e2-4446-49a9-9df6-44029c1085ff (c88008e2-4446-49a9-9df6-44029c1085ff): created successfully Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d453a4c-6809-4d97-81bb-bfbd4e3633bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:42:58 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Flow 'volume_create_manager' (925daa93-47a3-42ce-8285-fe3ce865bf6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:42:58 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0cab4f7b-422f-43d7-a27d-0a0b7b5119b2 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created volume successfully. Apr 10 10:42:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-c88008e2-4446-49a9-9df6-44029c1085ff-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-c88008e2-4446-49a9-9df6-44029c1085ff-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-quobyte-c88008e2-4446-49a9-9df6-44029c1085ff" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:42:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-c88008e2-4446-49a9-9df6-44029c1085ff" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:42:59 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cdde19-cf61-411a-9d5d-c5a02a7c7dae]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:42:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:59 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff Apr 10 10:42:59 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:42:59 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 10 10:42:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff" returned: 0 in 0.474s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:42:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:42:59 devstack sudo[89425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff Apr 10 10:42:59 devstack sudo[89425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:00 devstack sudo[89425]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c88008e2-4446-49a9-9df6-44029c1085ff" returned: 0 in 0.384s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-c88008e2-4446-49a9-9df6-44029c1085ff" released by "delete_volume" :: held 0.877s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created reservations ['388643c6-dd1b-4663-8168-c73334c8beb8', '199cdad3-1800-42b9-883e-e629f615d024', '64ae43b1-01e1-4878-9274-4a6673f908f0', 'e757ffd6-89ab-48d2-87fa-fa6a86d98c39'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:00 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:00 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-99831928-e718-4fd6-969b-85ebcdcd2179-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-99831928-e718-4fd6-969b-85ebcdcd2179-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-quobyte-99831928-e718-4fd6-969b-85ebcdcd2179" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-99831928-e718-4fd6-969b-85ebcdcd2179" acquired by "delete_volume" :: waited 0.007s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d39a162-ae32-48e9-b298-59bec3acdcb8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:00 devstack sudo[89430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179 Apr 10 10:43:00 devstack sudo[89430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:00 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.421s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:00 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Deleted volume successfully. Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a7f02c74-3454-4ce3-ada4-6b97f8cf4ce1 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-c88008e2-4446-49a9-9df6-44029c1085ff-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:00 devstack sudo[89430]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179" returned: 0 in 0.455s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:00 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179 Apr 10 10:43:00 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:01 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-99831928-e718-4fd6-969b-85ebcdcd2179" returned: 0 in 0.385s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-99831928-e718-4fd6-969b-85ebcdcd2179" released by "delete_volume" :: held 0.861s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created reservations ['81dcef97-5d9f-4736-abe2-22a1d4d22078', '933bedb4-0253-40a9-be65-df67acb9215f', '186e5226-aa36-413f-86b2-754e27218f70', '30d5dee6-0712-4959-aa0c-f20c3cb0294e'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:01 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:01 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-quobyte-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bc8a64-c7d5-413d-b9e1-18200d6183af]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:01 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 Apr 10 10:43:01 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:01 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.413s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:01 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Deleted volume successfully. Apr 10 10:43:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-0a278833-9a18-427d-b09e-ad996b8cb016 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-99831928-e718-4fd6-969b-85ebcdcd2179-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:02 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5" returned: 0 in 0.458s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:02 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5 Apr 10 10:43:02 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:02 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5" returned: 0 in 0.399s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5" released by "delete_volume" :: held 0.889s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Created reservations ['83c8284b-b369-474e-8f75-50103587f226', '171d3692-b763-49a3-b223-3ef6d9909740', '6bd38771-6443-4259-81de-b73a184e2f52', 'd149b534-614f-4f91-883d-df211502d7b3'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:02 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:02 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-8fe20fff-5ea2-4306-9025-ba8c4f1ce781-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-8fe20fff-5ea2-4306-9025-ba8c4f1ce781-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-quobyte-8fe20fff-5ea2-4306-9025-ba8c4f1ce781" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-8fe20fff-5ea2-4306-9025-ba8c4f1ce781" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dacbe6-b156-4a2e-9374-d0b1a15b65d6]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:02 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781 Apr 10 10:43:02 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:02 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.413s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:02 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Deleted volume successfully. Apr 10 10:43:02 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5e1ad24b-e5be-4d0a-9193-bdf37e94000f tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-36b1ea3f-4dfd-4319-9ea9-5fef1b7369d5-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:03 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781" returned: 0 in 0.453s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:03 devstack sudo[89493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781 Apr 10 10:43:03 devstack sudo[89493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:03 devstack sudo[89493]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fe20fff-5ea2-4306-9025-ba8c4f1ce781" returned: 0 in 0.384s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-8fe20fff-5ea2-4306-9025-ba8c4f1ce781" released by "delete_volume" :: held 0.857s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created reservations ['7943ff93-68b9-4214-997b-545f5cae1127', '82ab6f35-ed77-462b-b88e-604668056223', '57def3b4-3ca8-4718-8867-9b0ce9e802ce', '8e3b27ce-6477-46d1-803c-a999280d1678'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:03 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:03 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-cf7b4b0a-d5aa-496b-8590-c711983ee36f-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-cf7b4b0a-d5aa-496b-8590-c711983ee36f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-quobyte-cf7b4b0a-d5aa-496b-8590-c711983ee36f" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-cf7b4b0a-d5aa-496b-8590-c711983ee36f" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0e07ca-cbac-4587-841d-1399f35139cb]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:03 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f Apr 10 10:43:03 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:04 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.400s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:04 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Deleted volume successfully. Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-e6514e99-0d29-4ff7-a2f3-5ec4799c4ff3 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-8fe20fff-5ea2-4306-9025-ba8c4f1ce781-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:04 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f" returned: 0 in 0.439s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:04 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f Apr 10 10:43:04 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:04 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cf7b4b0a-d5aa-496b-8590-c711983ee36f" returned: 0 in 0.374s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-cf7b4b0a-d5aa-496b-8590-c711983ee36f" released by "delete_volume" :: held 0.842s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created reservations ['06516086-6334-4c89-82e5-e759193fabc1', '56f7e316-4da4-486b-91c7-8842e288e646', 'c86277fa-89ee-4751-9247-e74a9357adf2', '3f75a252-94f6-4a8e-a9fe-a1051ccb1f96'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:04 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:04 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-7d98e175-7eac-46c7-a67b-840c5ab9b295-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-7d98e175-7eac-46c7-a67b-840c5ab9b295-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-quobyte-2a8eee34-091f-4aee-98b3-c3226af3a4af" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-2a8eee34-091f-4aee-98b3-c3226af3a4af" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-quobyte-7d98e175-7eac-46c7-a67b-840c5ab9b295" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-7d98e175-7eac-46c7-a67b-840c5ab9b295" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Deleting offline snapshot 7d98e175-7eac-46c7-a67b-840c5ab9b295 of volume 2a8eee34-091f-4aee-98b3-c3226af3a4af {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] snapshot_file for this snap is: volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[979aaec8-1eb2-49d2-a16b-33998b7adaab]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:05 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 Apr 10 10:43:05 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:05 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.400s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:05 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:05 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Deleted volume successfully. Apr 10 10:43:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c23ba15a-2a15-4173-81c7-c5f1917e5961 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-cf7b4b0a-d5aa-496b-8590-c711983ee36f-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:05 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295" returned: 0 in 0.455s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a8eee34-091f-4aee-98b3-c3226af3a4af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:43:05 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c817c249-a1e4-4773-92ee-fcba06109897]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:05 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af Apr 10 10:43:05 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:05 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af" returned: 0 in 0.458s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:05 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 Apr 10 10:43:05 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:06 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295" returned: 0 in 0.486s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:06 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295 Apr 10 10:43:06 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:06 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af.7d98e175-7eac-46c7-a67b-840c5ab9b295" returned: 0 in 0.391s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-7d98e175-7eac-46c7-a67b-840c5ab9b295" released by "_delete_snapshot" :: held 1.850s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-2a8eee34-091f-4aee-98b3-c3226af3a4af" released by "delete_snapshot" :: held 1.863s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:06 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created reservations ['0756aefa-705a-4898-9069-bfcc2ab8ac7b', '1a8dc93d-2dd5-482c-a265-8923a27838b6', '40d255e0-e905-4389-bbc1-609a32a4cf64', '99d22805-3ae7-49c3-ac08-e2fdcac15420'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:06 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Delete snapshot completed successfully. Apr 10 10:43:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c2f29183-f7c6-424a-b0d5-d7dc4811eb63 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-7d98e175-7eac-46c7-a67b-840c5ab9b295-delete_snapshot" released by "delete_snapshot" :: held 1.940s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-2a8eee34-091f-4aee-98b3-c3226af3a4af-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-2a8eee34-091f-4aee-98b3-c3226af3a4af-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "cinder-quobyte-2a8eee34-091f-4aee-98b3-c3226af3a4af" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-2a8eee34-091f-4aee-98b3-c3226af3a4af" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[60107fb6-0de2-4c7b-8ce5-bcfb64ecc1ff]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:07 devstack sudo[89531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af Apr 10 10:43:07 devstack sudo[89531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:07 devstack sudo[89531]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af" returned: 0 in 0.437s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:07 devstack sudo[89536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af Apr 10 10:43:07 devstack sudo[89536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:07 devstack sudo[89536]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-2a8eee34-091f-4aee-98b3-c3226af3a4af" returned: 0 in 0.391s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-quobyte-2a8eee34-091f-4aee-98b3-c3226af3a4af" released by "delete_volume" :: held 0.854s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Created reservations ['55b86005-53b8-44a8-8efc-efd072bf2b70', 'c97b156f-3535-4336-b499-416a09e601df', '65d21e68-44a3-41f4-8a95-f7389cb40f89', 'af128acd-de9a-4f94-810a-90ffa9bfe625'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:08 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:08 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:08 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.438s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:08 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:08 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Deleted volume successfully. Apr 10 10:43:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4c58947-8782-4028-bacf-c17cecae4707 tempest-CreateVolumesFromSnapshotTest-532914684 None] Lock "cinder-2a8eee34-091f-4aee-98b3-c3226af3a4af-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=132,cinder:DELETE=15,cinder:INSERT=48,cinder:UPDATE=169 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=132,cinder:UPDATE=163,cinder:INSERT=36,cinder:DELETE=12 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (158b9416-2ca5-4412-9c41-d26924546b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c78a7ba-6360-4f69-9270-0ea002adf92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c78a7ba-6360-4f69-9270-0ea002adf92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016025909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2387ec-f7da-48e5-b91c-97a3bad6d882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:15Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad72d5d-113f-4daf-8d4e-3ada012b980f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad72d5d-113f-4daf-8d4e-3ada012b980f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7874cac-8562-477f-a9eb-a2499cd708a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7874cac-8562-477f-a9eb-a2499cd708a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc2387ec-f7da-48e5-b91c-97a3bad6d882', 'volume_name': 'volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ec2158-240a-4d8e-a54c-5437a6bc50fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ec2158-240a-4d8e-a54c-5437a6bc50fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7309bfe7-f32a-476b-9e0d-873709e8eb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume bc2387ec-f7da-48e5-b91c-97a3bad6d882: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882', 'volume_size': 1} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1016025909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc2387ec-f7da-48e5-b91c-97a3bad6d882,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:15Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Creating volume bc2387ec-f7da-48e5-b91c-97a3bad6d882 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:15 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:15 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 1073741824 Apr 10 10:43:15 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Flow 'volume_create_manager' (eca36a6e-3e22-4b3a-a048-6e4a23bc4fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672f70d2-60e5-4a37-b408-5e3a92f930da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (672f70d2-60e5-4a37-b408-5e3a92f930da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1475429473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba621d10-63dc-4f15-ac7f-cc312f0ba6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3016fbb901df4adcb994a9fec23ac8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:15Z,use_quota=True,user_id='9edf3e32472b4a2c855beffba9b8ff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82af16e1-1297-4c40-aa2d-f36442b5a87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82af16e1-1297-4c40-aa2d-f36442b5a87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1943c7-84d6-4b78-ba9a-0956300c446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da1943c7-84d6-4b78-ba9a-0956300c446f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba621d10-63dc-4f15-ac7f-cc312f0ba6e6', 'volume_name': 'volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3127315f-659f-4ce2-bde3-afb94e4c030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3127315f-659f-4ce2-bde3-afb94e4c030d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e248ce15-cdcd-4dcd-b065-95e3315910d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Volume ba621d10-63dc-4f15-ac7f-cc312f0ba6e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6', 'volume_size': 1} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Flow 'volume_create_manager' (334339b9-7c8c-4b7c-a720-36f79054f0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f932f1b7-0db6-418e-aff3-07b141cf986a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f932f1b7-0db6-418e-aff3-07b141cf986a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-252929684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488af1fd-bb61-4306-8d29-a26d7afe1da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a99750fa9114325bb75ef2b94a03cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:16Z,use_quota=True,user_id='b76722fa2882436982af60c684fc6283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b120a98-51aa-405a-8562-242031a9cf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b120a98-51aa-405a-8562-242031a9cf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18543964-a31c-4ab6-b26c-974ca361be68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18543964-a31c-4ab6-b26c-974ca361be68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488af1fd-bb61-4306-8d29-a26d7afe1da5', 'volume_name': 'volume-488af1fd-bb61-4306-8d29-a26d7afe1da5', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee62e4da-d464-4cd8-819c-cd621157a57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee62e4da-d464-4cd8-819c-cd621157a57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bfa74e-eedb-42fc-8e31-ad76c0c09ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Volume 488af1fd-bb61-4306-8d29-a26d7afe1da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488af1fd-bb61-4306-8d29-a26d7afe1da5', 'volume_size': 1} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Flow 'volume_create_manager' (3acdfad1-42d1-4405-9638-c66e6a336dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd744f5-1db9-41f7-8955-0338809bcaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfd744f5-1db9-41f7-8955-0338809bcaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826191172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a247a3f3-7071-4217-94c0-7e22188d453f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3016fbb901df4adcb994a9fec23ac8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:16Z,use_quota=True,user_id='9edf3e32472b4a2c855beffba9b8ff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4ce3cd-553f-4b2f-86d2-b1e34ea758b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4ce3cd-553f-4b2f-86d2-b1e34ea758b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac9a2e4-bf09-40b9-960b-4059e44a5bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ac9a2e4-bf09-40b9-960b-4059e44a5bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a247a3f3-7071-4217-94c0-7e22188d453f', 'volume_name': 'volume-a247a3f3-7071-4217-94c0-7e22188d453f', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab1c080-074b-4dc3-a0c8-67a395b5c331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ab1c080-074b-4dc3-a0c8-67a395b5c331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe404c5e-a87a-41d8-ad4c-1823b25b3120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Volume a247a3f3-7071-4217-94c0-7e22188d453f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a247a3f3-7071-4217-94c0-7e22188d453f', 'volume_size': 1} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Flow 'volume_create_manager' (976d8cb3-ea01-458e-81da-63c8be99b08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d323c7-abb0-4395-b518-8fcbc841d95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8d323c7-abb0-4395-b518-8fcbc841d95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639549104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d923c5b-4c97-4fc9-8968-dc61c17d6ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3016fbb901df4adcb994a9fec23ac8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:16Z,use_quota=True,user_id='9edf3e32472b4a2c855beffba9b8ff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102c8d74-8c77-4a1a-b0c3-13eb15f4c103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:15 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (102c8d74-8c77-4a1a-b0c3-13eb15f4c103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417575fc-1704-4b95-bb73-e406155795de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (417575fc-1704-4b95-bb73-e406155795de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d923c5b-4c97-4fc9-8968-dc61c17d6ed1', 'volume_name': 'volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9be9357-65d5-42b7-a4b0-16f7d1bfd305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9be9357-65d5-42b7-a4b0-16f7d1bfd305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f662c0f-7e66-4dd4-9911-7d57e6942ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Volume 0d923c5b-4c97-4fc9-8968-dc61c17d6ed1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1', 'volume_size': 1} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Flow 'volume_create_manager' (5112d8ce-deec-4683-8b80-55d8b33ad13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78857029-0274-4eb2-9f4c-7c50dbb802b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78857029-0274-4eb2-9f4c-7c50dbb802b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-443364128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56d81aa-17db-4304-9f5b-223ea372e7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3016fbb901df4adcb994a9fec23ac8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:16Z,use_quota=True,user_id='9edf3e32472b4a2c855beffba9b8ff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8ea6e4-a11e-42ff-82a0-bff7dba1011c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8ea6e4-a11e-42ff-82a0-bff7dba1011c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25fed3b6-329d-42ae-a311-f7a83f3152ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25fed3b6-329d-42ae-a311-f7a83f3152ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c56d81aa-17db-4304-9f5b-223ea372e7ad', 'volume_name': 'volume-c56d81aa-17db-4304-9f5b-223ea372e7ad', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7e2bd1-e47a-401e-a4d8-c059b6853036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7e2bd1-e47a-401e-a4d8-c059b6853036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89284d17-3d13-4803-b325-f25c2bc587a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Volume c56d81aa-17db-4304-9f5b-223ea372e7ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c56d81aa-17db-4304-9f5b-223ea372e7ad', 'volume_size': 1} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 1073741824" returned: 0 in 0.825s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:16 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 Apr 10 10:43:16 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Flow 'volume_create_manager' (71a0a398-6e91-432e-82f4-ca4ee8a4b38a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9c6f70-5a6d-4d14-929e-ffc90685fae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc9c6f70-5a6d-4d14-929e-ffc90685fae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797740552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8863021c-035e-4d6e-8829-2747ebc44a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3016fbb901df4adcb994a9fec23ac8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:16Z,use_quota=True,user_id='9edf3e32472b4a2c855beffba9b8ff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587a14cb-3101-4125-96a8-2e027208362a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (587a14cb-3101-4125-96a8-2e027208362a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7ae646-165b-4f7f-9f95-da2bd9fa523a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7ae646-165b-4f7f-9f95-da2bd9fa523a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8863021c-035e-4d6e-8829-2747ebc44a5b', 'volume_name': 'volume-8863021c-035e-4d6e-8829-2747ebc44a5b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08bea01-6108-42f3-ba72-6efe4d252721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08bea01-6108-42f3-ba72-6efe4d252721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2904c6a8-911a-4d99-995e-856215682919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Volume 8863021c-035e-4d6e-8829-2747ebc44a5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8863021c-035e-4d6e-8829-2747ebc44a5b', 'volume_size': 1} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:16 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882" returned: 0 in 0.454s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1475429473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba621d10-63dc-4f15-ac7f-cc312f0ba6e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3016fbb901df4adcb994a9fec23ac8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:15Z,use_quota=True,user_id='9edf3e32472b4a2c855beffba9b8ff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Creating volume ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:16 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7309bfe7-f32a-476b-9e0d-873709e8eb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 1073741824 Apr 10 10:43:16 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301e516d-219a-4267-9f59-622157a9933c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:16 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 (bc2387ec-f7da-48e5-b91c-97a3bad6d882): created successfully Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (301e516d-219a-4267-9f59-622157a9933c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:16 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (158b9416-2ca5-4412-9c41-d26924546b5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:16 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-3ff0e5c7-d3e7-43a2-9f5f-838a14c4f956 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created volume successfully. Apr 10 10:43:17 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 1073741824" returned: 0 in 0.489s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:17 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 Apr 10 10:43:17 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:17 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6" returned: 0 in 0.527s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.811s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-252929684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488af1fd-bb61-4306-8d29-a26d7afe1da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a99750fa9114325bb75ef2b94a03cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:16Z,use_quota=True,user_id='b76722fa2882436982af60c684fc6283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Creating volume 488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:17 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e248ce15-cdcd-4dcd-b065-95e3315910d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:17 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 1073741824 Apr 10 10:43:17 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7724f6-6a7e-454c-bd81-9ad69c38b44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:17 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Volume volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 (ba621d10-63dc-4f15-ac7f-cc312f0ba6e6): created successfully Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7724f6-6a7e-454c-bd81-9ad69c38b44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:17 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Flow 'volume_create_manager' (eca36a6e-3e22-4b3a-a048-6e4a23bc4fee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:17 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c531a16b-7a27-4be9-b4a0-c29988216bb4 tempest-CreateVolumesFromImageTest-1021670800 None] Created volume successfully. Apr 10 10:43:18 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 1073741824" returned: 0 in 0.531s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:18 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 Apr 10 10:43:18 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:18 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5" returned: 0 in 0.455s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.721s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-826191172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a247a3f3-7071-4217-94c0-7e22188d453f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3016fbb901df4adcb994a9fec23ac8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:16Z,use_quota=True,user_id='9edf3e32472b4a2c855beffba9b8ff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Creating volume a247a3f3-7071-4217-94c0-7e22188d453f {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:18 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0bfa74e-eedb-42fc-8e31-ad76c0c09ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488af1fd-bb61-4306-8d29-a26d7afe1da5', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7669f556-14a9-443f-a27e-78ee334bfc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:18 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f 1073741824 Apr 10 10:43:18 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:18 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Volume volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 (488af1fd-bb61-4306-8d29-a26d7afe1da5): created successfully Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7669f556-14a9-443f-a27e-78ee334bfc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:18 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Flow 'volume_create_manager' (334339b9-7c8c-4b7c-a720-36f79054f0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:18 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-de6e4ba7-5526-4d3d-8f8d-114baabcc6ee tempest-VolumeDependencyTests-671945497 None] Created volume successfully. Apr 10 10:43:19 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f 1073741824" returned: 0 in 0.483s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:19 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f Apr 10 10:43:19 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:19 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f" returned: 0 in 0.495s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.680s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-639549104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d923c5b-4c97-4fc9-8968-dc61c17d6ed1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3016fbb901df4adcb994a9fec23ac8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:16Z,use_quota=True,user_id='9edf3e32472b4a2c855beffba9b8ff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Creating volume 0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:19 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe404c5e-a87a-41d8-ad4c-1823b25b3120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a247a3f3-7071-4217-94c0-7e22188d453f', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1512b69-d59d-4330-acfa-cd186c806942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:19 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Volume volume-a247a3f3-7071-4217-94c0-7e22188d453f (a247a3f3-7071-4217-94c0-7e22188d453f): created successfully Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1512b69-d59d-4330-acfa-cd186c806942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Flow 'volume_create_manager' (3acdfad1-42d1-4405-9638-c66e6a336dbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:19 devstack sudo[89617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 1073741824 Apr 10 10:43:19 devstack sudo[89617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:19 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-01774328-6734-48e4-b0a5-ac03151eab3a tempest-CreateVolumesFromImageTest-1021670800 None] Created volume successfully. Apr 10 10:43:19 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:20 devstack sudo[89617]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 1073741824" returned: 0 in 0.541s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:20 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 Apr 10 10:43:20 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:20 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1" returned: 0 in 0.506s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.648s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-443364128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c56d81aa-17db-4304-9f5b-223ea372e7ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3016fbb901df4adcb994a9fec23ac8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:16Z,use_quota=True,user_id='9edf3e32472b4a2c855beffba9b8ff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Creating volume c56d81aa-17db-4304-9f5b-223ea372e7ad {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:20 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f662c0f-7e66-4dd4-9911-7d57e6942ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c66d46-12ef-4848-a3a5-82deb0e10a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:20 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad 1073741824 Apr 10 10:43:20 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:20 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Volume volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 (0d923c5b-4c97-4fc9-8968-dc61c17d6ed1): created successfully Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09c66d46-12ef-4848-a3a5-82deb0e10a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:20 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Flow 'volume_create_manager' (976d8cb3-ea01-458e-81da-63c8be99b08d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:20 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-43158258-3655-4452-bd20-291607d0351f tempest-CreateVolumesFromImageTest-1021670800 None] Created volume successfully. Apr 10 10:43:21 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad 1073741824" returned: 0 in 0.577s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:21 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad Apr 10 10:43:21 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:21 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad" returned: 0 in 0.456s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.549s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797740552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8863021c-035e-4d6e-8829-2747ebc44a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3016fbb901df4adcb994a9fec23ac8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:16Z,use_quota=True,user_id='9edf3e32472b4a2c855beffba9b8ff9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Creating volume 8863021c-035e-4d6e-8829-2747ebc44a5b {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:21 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89284d17-3d13-4803-b325-f25c2bc587a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c56d81aa-17db-4304-9f5b-223ea372e7ad', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:21 devstack sudo[89633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b 1073741824 Apr 10 10:43:21 devstack sudo[89633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3753f91c-0231-4d45-8c52-8d07e7cbb557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:21 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Volume volume-c56d81aa-17db-4304-9f5b-223ea372e7ad (c56d81aa-17db-4304-9f5b-223ea372e7ad): created successfully Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3753f91c-0231-4d45-8c52-8d07e7cbb557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:21 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Flow 'volume_create_manager' (5112d8ce-deec-4683-8b80-55d8b33ad13e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:21 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a0262507-1ab1-4716-a797-136819db8261 tempest-CreateVolumesFromImageTest-1021670800 None] Created volume successfully. Apr 10 10:43:22 devstack sudo[89633]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b 1073741824" returned: 0 in 0.505s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:22 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b Apr 10 10:43:22 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:22 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b" returned: 0 in 0.457s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.313s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2904c6a8-911a-4d99-995e-856215682919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8863021c-035e-4d6e-8829-2747ebc44a5b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c12abde-c7a9-4650-bd51-5589c436ff96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Creating offline snapshot fd358381-7a71-4f26-99b5-725373ae2ef8 of volume bc2387ec-f7da-48e5-b91c-97a3bad6d882 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:43:22 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Volume volume-8863021c-035e-4d6e-8829-2747ebc44a5b (8863021c-035e-4d6e-8829-2747ebc44a5b): created successfully Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c12abde-c7a9-4650-bd51-5589c436ff96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Flow 'volume_create_manager' (71a0a398-6e91-432e-82f4-ca4ee8a4b38a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d4ccf5-1a61-4e2a-b1ce-320a64280ff7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:22 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:22 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-2c96c538-eaa9-43a5-9a18-cd3492d59958 tempest-CreateVolumesFromImageTest-1021670800 None] Created volume successfully. Apr 10 10:43:22 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 Apr 10 10:43:22 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:23 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882" returned: 0 in 0.530s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:23 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 1G Apr 10 10:43:23 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "cinder-8863021c-035e-4d6e-8829-2747ebc44a5b-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-8863021c-035e-4d6e-8829-2747ebc44a5b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "cinder-quobyte-8863021c-035e-4d6e-8829-2747ebc44a5b" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:23 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-quobyte-8863021c-035e-4d6e-8829-2747ebc44a5b" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:23 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88d88a1-79b9-40bd-9421-8f5e3490455c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:23 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b Apr 10 10:43:23 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:23 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 1G" returned: 0 in 0.570s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:23 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:24 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 Apr 10 10:43:24 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:24 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b" returned: 0 in 0.533s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:24 devstack sudo[89662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b Apr 10 10:43:24 devstack sudo[89662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:24 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8" returned: 0 in 0.532s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:24 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 is being set with open permissions: ugo+rw Apr 10 10:43:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:24 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 Apr 10 10:43:24 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:24 devstack sudo[89662]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8863021c-035e-4d6e-8829-2747ebc44a5b" returned: 0 in 0.457s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:24 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-quobyte-8863021c-035e-4d6e-8829-2747ebc44a5b" released by "delete_volume" :: held 1.027s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:24 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Created reservations ['6bc3c3cd-ccd2-4a1a-b570-433d213c7a87', 'fe9e6a83-a55d-4987-b0fc-0a4d50f0a67d', 'd3e4cd5f-6dd0-4299-91d5-d07b127efadb', '91f7ca48-68ac-4d63-8659-4d8958c59cef'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:24 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:24 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:25 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:25 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:25 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:25 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8" returned: 0 in 0.519s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:25 devstack sudo[89670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.info Apr 10 10:43:25 devstack sudo[89670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:25 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.510s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:25 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:25 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Deleted volume successfully. Apr 10 10:43:25 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4db90424-6c20-403e-b427-6c9fd656ab62 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-8863021c-035e-4d6e-8829-2747ebc44a5b-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:25 devstack sudo[89670]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.info" returned: 0 in 0.537s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:25 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.info is being set with open permissions: ugo+rw Apr 10 10:43:25 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:25 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.info Apr 10 10:43:25 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "cinder-c56d81aa-17db-4304-9f5b-223ea372e7ad-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-c56d81aa-17db-4304-9f5b-223ea372e7ad-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:26 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.info" returned: 0 in 0.455s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.227s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.164s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Creating offline snapshot e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba of volume 488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "cinder-quobyte-c56d81aa-17db-4304-9f5b-223ea372e7ad" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8595e2eb-8bfa-4a89-ab30-68c73ad6329b]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:26 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f9ba1154-a8c9-4a97-99e6-d9c733a08f82 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Create snapshot completed successfully Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-quobyte-c56d81aa-17db-4304-9f5b-223ea372e7ad" acquired by "delete_volume" :: waited 0.035s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[79786f4a-ea94-416e-884e-9432bca86e2a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:26 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 Apr 10 10:43:26 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:26 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad Apr 10 10:43:26 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:26 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5" returned: 0 in 0.575s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:26 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad" returned: 0 in 0.561s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:26 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:26 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba 1G Apr 10 10:43:26 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:26 devstack sudo[89689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad Apr 10 10:43:26 devstack sudo[89689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (e53a0031-d248-4088-bd2a-bfc432471061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3841ef-8911-44ed-82f1-33d18b369dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3841ef-8911-44ed-82f1-33d18b369dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-538988043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49840fa2-cb17-45c9-90ae-af918b8b4403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:27Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a95c22-4b17-4484-b5f8-341d267c6a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18a95c22-4b17-4484-b5f8-341d267c6a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51986a06-91e1-4617-9fff-3f93b5b0f5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51986a06-91e1-4617-9fff-3f93b5b0f5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49840fa2-cb17-45c9-90ae-af918b8b4403', 'volume_name': 'volume-49840fa2-cb17-45c9-90ae-af918b8b4403', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b28c0a-06c3-42dd-b6ac-ac54baa1ab8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b28c0a-06c3-42dd-b6ac-ac54baa1ab8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa44a88c-6c79-4f20-bff1-86ca4d197985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume 49840fa2-cb17-45c9-90ae-af918b8b4403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49840fa2-cb17-45c9-90ae-af918b8b4403', 'volume_size': 1} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (0da610bd-4370-4e80-99a0-435e623c823b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff940de-25cc-4b74-a949-d04c218afb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bff940de-25cc-4b74-a949-d04c218afb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144880305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdbeb71-c904-4a73-87ea-a1c8c98df40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:27Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2110b636-c914-4a6b-a8bd-9a3fa1a2ce90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2110b636-c914-4a6b-a8bd-9a3fa1a2ce90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1702dbd8-71e6-45aa-a83f-c24f3a18e49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1702dbd8-71e6-45aa-a83f-c24f3a18e49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fdbeb71-c904-4a73-87ea-a1c8c98df40e', 'volume_name': 'volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c79450-2701-4158-af1c-ed6b654a435b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93c79450-2701-4158-af1c-ed6b654a435b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f60bcf-33e2-4bf2-bf53-4d7fae34efa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume 8fdbeb71-c904-4a73-87ea-a1c8c98df40e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e', 'volume_size': 1} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:27 devstack sudo[89689]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-c56d81aa-17db-4304-9f5b-223ea372e7ad" returned: 0 in 0.758s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-quobyte-c56d81aa-17db-4304-9f5b-223ea372e7ad" released by "delete_volume" :: held 1.344s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Created reservations ['00b22929-4a96-4270-baa8-38903f83c27c', 'def73e76-d505-4066-9023-26ba1ab0f54e', 'c85a567c-0197-4485-a631-71264781cded', 'f41683be-db95-458f-8569-1b49d2afc8aa'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:27 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba 1G" returned: 0 in 0.889s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:27 devstack sudo[89695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba Apr 10 10:43:27 devstack sudo[89695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:27 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:27 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (0b397ddd-8533-4214-a226-9da636c5bdaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fd6d2d-e4e4-40eb-95c6-fcee0e094481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fd6d2d-e4e4-40eb-95c6-fcee0e094481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1456329843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745ff0e7-6e5b-46f7-9b29-c3103328e3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:28Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92cd1844-ddaa-41cb-9fd0-d2b76fab6bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92cd1844-ddaa-41cb-9fd0-d2b76fab6bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3cc111-b8fd-498b-9860-bfeb9af00cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f3cc111-b8fd-498b-9860-bfeb9af00cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745ff0e7-6e5b-46f7-9b29-c3103328e3a0', 'volume_name': 'volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3291fe00-4d78-49b8-97d1-dd7e8aa0c754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3291fe00-4d78-49b8-97d1-dd7e8aa0c754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a891177a-f24c-44d6-8aeb-9fc90142bcb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume 745ff0e7-6e5b-46f7-9b29-c3103328e3a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0', 'volume_size': 1} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Flow 'volume_create_manager' (3477c236-34c2-42ca-9c6c-1795916c0eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096ad2e2-fbe3-4d38-a2d2-deb682b7256b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (096ad2e2-fbe3-4d38-a2d2-deb682b7256b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1048669014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f223e8c-5bd7-4504-b736-50eb35e8ef27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09f6653a9d874ce390bad0d887ecb7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:28Z,use_quota=True,user_id='41cf0995ff15488b96e9d7e0de7b024e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cdb830-4732-4e0c-b647-cc70ad13f9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:27 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85cdb830-4732-4e0c-b647-cc70ad13f9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f961df75-dcf0-4742-8faf-a759de696622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f961df75-dcf0-4742-8faf-a759de696622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f223e8c-5bd7-4504-b736-50eb35e8ef27', 'volume_name': 'volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95204d78-8a4e-4f52-8f60-6d28798fc2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95204d78-8a4e-4f52-8f60-6d28798fc2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06da98c2-5992-4180-b9b4-14b41c59abea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Volume 3f223e8c-5bd7-4504-b736-50eb35e8ef27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27', 'volume_size': 1} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (3310a368-fa9f-4e2c-9f7d-d69652013b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a888b57-6fe8-48e3-9ad4-a141fd810128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a888b57-6fe8-48e3-9ad4-a141fd810128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1443385794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05105a9f-16ac-4f47-b565-952def9cbbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:28Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37af49b-5ece-4f77-af9a-6e0ca3a09c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37af49b-5ece-4f77-af9a-6e0ca3a09c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596b27c1-cfa0-473c-ad4d-4ad110876989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (596b27c1-cfa0-473c-ad4d-4ad110876989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05105a9f-16ac-4f47-b565-952def9cbbc7', 'volume_name': 'volume-05105a9f-16ac-4f47-b565-952def9cbbc7', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd544749-31f4-45bc-93c1-f368fb7c9de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd544749-31f4-45bc-93c1-f368fb7c9de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab89fff0-43f9-4947-856c-b30ad26306e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume 05105a9f-16ac-4f47-b565-952def9cbbc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05105a9f-16ac-4f47-b565-952def9cbbc7', 'volume_size': 1} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "cinder-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:28 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.653s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:28 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Deleted volume successfully. Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "cinder-quobyte-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-c7f0445e-fe27-4a29-9600-4338d59a6648 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-c56d81aa-17db-4304-9f5b-223ea372e7ad-delete_volume" released by "delete_volume" :: held 2.294s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:28 devstack sudo[89695]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (35b2ba5b-e701-4902-a706-b445ae9cc9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709c7178-f23d-474d-aa2d-2d1793e4bf13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba" returned: 0 in 0.755s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:28 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba is being set with open permissions: ugo+rw Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:28 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba Apr 10 10:43:28 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709c7178-f23d-474d-aa2d-2d1793e4bf13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1015120127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55301236-42a8-432b-ae11-db124b98d6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:28Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a0a982-7b71-433d-a506-9eadd742c464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a0a982-7b71-433d-a506-9eadd742c464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a25bd8-b8b8-4bf1-9184-db3091262a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7a25bd8-b8b8-4bf1-9184-db3091262a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55301236-42a8-432b-ae11-db124b98d6bc', 'volume_name': 'volume-55301236-42a8-432b-ae11-db124b98d6bc', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98efc055-a7e9-483b-bb7d-69dcfc2b2d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98efc055-a7e9-483b-bb7d-69dcfc2b2d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5588f6-674d-4b85-aa03-7ed6cfde14df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:28 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume 55301236-42a8-432b-ae11-db124b98d6bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55301236-42a8-432b-ae11-db124b98d6bc', 'volume_size': 1} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-quobyte-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1" acquired by "delete_volume" :: waited 0.084s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff924558-cbcd-4e5a-aeff-840e391b6e43]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:28 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 Apr 10 10:43:28 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:28 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba" returned: 0 in 0.384s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:28 devstack sudo[89708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.info Apr 10 10:43:28 devstack sudo[89708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:28 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1" returned: 0 in 0.451s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:28 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:28 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1 Apr 10 10:43:28 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:29 devstack sudo[89708]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.info" returned: 0 in 0.422s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:29 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.info is being set with open permissions: ugo+rw Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:29 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.info Apr 10 10:43:29 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:29 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1" returned: 0 in 0.393s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-quobyte-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1" released by "delete_volume" :: held 0.864s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Created reservations ['2529fd14-55c6-4ec5-ad0a-6b1027dde8be', '03594a0a-33da-4ae8-9b3c-072c0c656ba3', '6d0268ce-1213-4a47-92c2-4215c4b3fed7', '0be66171-6bfe-490a-b894-252c39c0a129'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:29 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:29 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "cinder-a247a3f3-7071-4217-94c0-7e22188d453f-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-a247a3f3-7071-4217-94c0-7e22188d453f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "cinder-quobyte-a247a3f3-7071-4217-94c0-7e22188d453f" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-quobyte-a247a3f3-7071-4217-94c0-7e22188d453f" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c28f78d-3d87-4883-9a83-25ca015b9383]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:29 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f Apr 10 10:43:29 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:29 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.info" returned: 0 in 0.425s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.552s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.312s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-538988043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49840fa2-cb17-45c9-90ae-af918b8b4403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:27Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Creating volume 49840fa2-cb17-45c9-90ae-af918b8b4403 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:29 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:29 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403 1073741824 Apr 10 10:43:29 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-67304240-f089-4472-8597-52a44316d3ee tempest-VolumeDependencyTests-671945497 None] Create snapshot completed successfully Apr 10 10:43:29 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:29 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.473s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:29 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Deleted volume successfully. Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c54fd32-42a6-4fba-9fb0-451c853c123f tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-0d923c5b-4c97-4fc9-8968-dc61c17d6ed1-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:29 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f" returned: 0 in 0.490s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:29 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:29 devstack sudo[89730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f Apr 10 10:43:29 devstack sudo[89730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:30 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403 1073741824" returned: 0 in 0.492s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:30 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403 Apr 10 10:43:30 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:30 devstack sudo[89730]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-a247a3f3-7071-4217-94c0-7e22188d453f" returned: 0 in 0.428s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-quobyte-a247a3f3-7071-4217-94c0-7e22188d453f" released by "delete_volume" :: held 0.942s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Created reservations ['e4a132b9-cf15-41f5-bfe3-382c47e38538', 'b3acc0e7-865d-4fd0-ba49-7ec05a53c0a9', 'f5980366-a94c-44d3-a387-51d57b46fa8d', '452f8fc3-b54a-41b2-8c38-24c4ab96b111'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:30 devstack sudo[89738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:30 devstack sudo[89738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "cinder-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "cinder-quobyte-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Flow 'volume_create_manager' (db2d3612-2f01-4be6-97a7-ab17a7909e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d971e33-5034-40a8-9c5f-28f7d21739f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-quobyte-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6" acquired by "delete_volume" :: waited 0.027s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[087942e6-7558-463a-9734-840684139711]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:30 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d971e33-5034-40a8-9c5f-28f7d21739f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1947074766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59daea5a-6ac7-4564-82bc-d9638ac3125c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a99750fa9114325bb75ef2b94a03cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:31Z,use_quota=True,user_id='b76722fa2882436982af60c684fc6283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d83144-69a9-434a-afb0-76f5eb6478bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48d83144-69a9-434a-afb0-76f5eb6478bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc5dccd-32c0-4e29-b9ee-40ee75a73372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc5dccd-32c0-4e29-b9ee-40ee75a73372) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59daea5a-6ac7-4564-82bc-d9638ac3125c', 'volume_name': 'volume-59daea5a-6ac7-4564-82bc-d9638ac3125c', 'volume_size': 1, 'snapshot_id': 'e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbecdd5f-92cc-4710-87ac-9214b5fef704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbecdd5f-92cc-4710-87ac-9214b5fef704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fa2c5b-da39-4b13-9e0f-c25a7da7bd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:30 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Volume 59daea5a-6ac7-4564-82bc-d9638ac3125c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59daea5a-6ac7-4564-82bc-d9638ac3125c', 'volume_size': 1, 'snapshot_id': 'e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba'} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403" returned: 0 in 0.535s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.245s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2144880305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fdbeb71-c904-4a73-87ea-a1c8c98df40e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:27Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Creating volume 8fdbeb71-c904-4a73-87ea-a1c8c98df40e {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:30 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:30 devstack sudo[89741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 Apr 10 10:43:30 devstack sudo[89741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa44a88c-6c79-4f20-bff1-86ca4d197985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49840fa2-cb17-45c9-90ae-af918b8b4403', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:30 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e 1073741824 Apr 10 10:43:30 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcd9bf5-8295-48d1-b63c-c05012b050e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:30 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume volume-49840fa2-cb17-45c9-90ae-af918b8b4403 (49840fa2-cb17-45c9-90ae-af918b8b4403): created successfully Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0dcd9bf5-8295-48d1-b63c-c05012b050e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (e53a0031-d248-4088-bd2a-bfc432471061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:30 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4bab5415-9caa-4c30-93bf-ec08dde96b73 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created volume successfully. Apr 10 10:43:30 devstack sudo[89738]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.453s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:30 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Deleted volume successfully. Apr 10 10:43:30 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-320ef503-2250-4752-89d0-9279e22afd7d tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-a247a3f3-7071-4217-94c0-7e22188d453f-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:31 devstack sudo[89741]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6" returned: 0 in 0.481s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:31 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6 Apr 10 10:43:31 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:31 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e 1073741824" returned: 0 in 0.502s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:31 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e Apr 10 10:43:31 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:31 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6" returned: 0 in 0.414s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-quobyte-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6" released by "delete_volume" :: held 0.928s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Created reservations ['e9dcbf40-2cbf-4e09-bb9c-76e314cb2d6c', '91f36d5c-5025-4b76-b851-72167e7fabc4', '373201a1-4f5b-4d61-b131-051a12aa9e53', '0b16915d-17f0-4590-87c4-b7acdf70894b'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:31 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:31 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:31 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e" returned: 0 in 0.445s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.809s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1456329843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745ff0e7-6e5b-46f7-9b29-c3103328e3a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:28Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Creating volume 745ff0e7-6e5b-46f7-9b29-c3103328e3a0 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:31 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2f60bcf-33e2-4bf2-bf53-4d7fae34efa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:31 devstack sudo[89760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0 1073741824 Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b39ef6c-9a5b-41fd-a215-8acc454aeb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:31 devstack sudo[89760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:31 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e (8fdbeb71-c904-4a73-87ea-a1c8c98df40e): created successfully Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b39ef6c-9a5b-41fd-a215-8acc454aeb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:31 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (0da610bd-4370-4e80-99a0-435e623c823b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:31 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d43f2fdf-8cae-4270-991e-46625773dfa5 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created volume successfully. Apr 10 10:43:32 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.423s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:32 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Deleted volume successfully. Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7b4e7b36-faf2-48ee-a1d0-3f85ceec9624 tempest-CreateVolumesFromImageTest-1021670800 None] Lock "cinder-ba621d10-63dc-4f15-ac7f-cc312f0ba6e6-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:32 devstack sudo[89760]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0 1073741824" returned: 0 in 0.588s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:32 devstack sudo[89767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0 Apr 10 10:43:32 devstack sudo[89767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:32 devstack sudo[89767]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0" returned: 0 in 0.449s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.748s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1048669014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f223e8c-5bd7-4504-b736-50eb35e8ef27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09f6653a9d874ce390bad0d887ecb7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:28Z,use_quota=True,user_id='41cf0995ff15488b96e9d7e0de7b024e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Creating volume 3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:32 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a891177a-f24c-44d6-8aeb-9fc90142bcb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:32 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 1073741824 Apr 10 10:43:32 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbba70b7-db24-4325-80ff-84aa8134362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:32 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0 (745ff0e7-6e5b-46f7-9b29-c3103328e3a0): created successfully Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbba70b7-db24-4325-80ff-84aa8134362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:32 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (0b397ddd-8533-4214-a226-9da636c5bdaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:32 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-63e647ef-c950-4058-ba4b-1c1cf3814995 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created volume successfully. Apr 10 10:43:33 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 1073741824" returned: 0 in 0.547s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:33 devstack sudo[89775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 Apr 10 10:43:33 devstack sudo[89775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Flow 'volume_create_manager' (3d9de7b9-f948-4323-b54f-23cee2cd7907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2062c3d6-b661-49bd-9b24-d326bd527c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2062c3d6-b661-49bd-9b24-d326bd527c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf49405-da56-4518-bd70-15789f4ae30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a125c3c94f6b4232936a0c0076dd5322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:33Z,use_quota=True,user_id='36bf7e8b274d4b1b92c0a577a1b3b966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cdabdb-b1d7-4fa8-9445-1ebd6ab1fca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cdabdb-b1d7-4fa8-9445-1ebd6ab1fca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb42023e-bf0e-4698-b8ba-1e5d3f616503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb42023e-bf0e-4698-b8ba-1e5d3f616503) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf49405-da56-4518-bd70-15789f4ae30b', 'volume_name': 'volume-7bf49405-da56-4518-bd70-15789f4ae30b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0d44cd-8fad-4952-9395-e78a13a02c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0d44cd-8fad-4952-9395-e78a13a02c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b204e56f-21ee-4fa9-88ce-779b60980f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:33 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Volume 7bf49405-da56-4518-bd70-15789f4ae30b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf49405-da56-4518-bd70-15789f4ae30b', 'volume_size': 1} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:33 devstack sudo[89775]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27" returned: 0 in 0.455s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.561s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1443385794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05105a9f-16ac-4f47-b565-952def9cbbc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:28Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Creating volume 05105a9f-16ac-4f47-b565-952def9cbbc7 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:33 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06da98c2-5992-4180-b9b4-14b41c59abea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:33 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7 1073741824 Apr 10 10:43:33 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a2d1bf-d983-4951-9ab2-8fdecde423e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:33 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Volume volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 (3f223e8c-5bd7-4504-b736-50eb35e8ef27): created successfully Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a2d1bf-d983-4951-9ab2-8fdecde423e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:33 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Flow 'volume_create_manager' (3477c236-34c2-42ca-9c6c-1795916c0eab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:33 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-dcb3bb0c-df5d-4404-b5e3-4679800d4a67 tempest-SnapshotDependencyTests-1563621178 None] Created volume successfully. Apr 10 10:43:34 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7 1073741824" returned: 0 in 0.481s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:34 devstack sudo[89783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7 Apr 10 10:43:34 devstack sudo[89783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:34 devstack sudo[89783]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7" returned: 0 in 0.401s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.292s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1015120127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55301236-42a8-432b-ae11-db124b98d6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b91f6692d7a44639a3dd26e73cc96e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:28Z,use_quota=True,user_id='411e8d339c24461da195377f46b756f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Creating volume 55301236-42a8-432b-ae11-db124b98d6bc {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:34 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:34 devstack sudo[89786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc 1073741824 Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab89fff0-43f9-4947-856c-b30ad26306e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05105a9f-16ac-4f47-b565-952def9cbbc7', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:34 devstack sudo[89786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6f3ec8-40f2-4a55-82b5-0eb86acef5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:34 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume volume-05105a9f-16ac-4f47-b565-952def9cbbc7 (05105a9f-16ac-4f47-b565-952def9cbbc7): created successfully Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca6f3ec8-40f2-4a55-82b5-0eb86acef5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:34 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (3310a368-fa9f-4e2c-9f7d-d69652013b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:34 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-18f52156-f3c2-4581-a254-b11acbce73bd tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created volume successfully. Apr 10 10:43:35 devstack sudo[89786]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc 1073741824" returned: 0 in 0.448s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:35 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc Apr 10 10:43:35 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:35 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc" returned: 0 in 0.397s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.866s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-quobyte-e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba-59daea5a-6ac7-4564-82bc-d9638ac3125c" by "_create_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5588f6-674d-4b85-aa03-7ed6cfde14df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55301236-42a8-432b-ae11-db124b98d6bc', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4461c989-ad74-47c8-93bf-9a8144fae83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba-59daea5a-6ac7-4564-82bc-d9638ac3125c" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Creating volume 59daea5a-6ac7-4564-82bc-d9638ac3125c from snapshot e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba {{(pid=82038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-quobyte-59daea5a-6ac7-4564-82bc-d9638ac3125c" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:35 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Volume volume-55301236-42a8-432b-ae11-db124b98d6bc (55301236-42a8-432b-ae11-db124b98d6bc): created successfully Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4461c989-ad74-47c8-93bf-9a8144fae83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Flow 'volume_create_manager' (35b2ba5b-e701-4902-a706-b445ae9cc9c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-59daea5a-6ac7-4564-82bc-d9638ac3125c" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] snapshot: e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba, volume: 59daea5a-6ac7-4564-82bc-d9638ac3125c, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:43:35 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-18f19c55-45b8-4987-bea0-37ee4d8cdf5e tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created volume successfully. Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f86e398-ab51-4438-b906-8930dfefc092]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:35 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba Apr 10 10:43:35 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-55301236-42a8-432b-ae11-db124b98d6bc-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-55301236-42a8-432b-ae11-db124b98d6bc-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-quobyte-55301236-42a8-432b-ae11-db124b98d6bc" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-55301236-42a8-432b-ae11-db124b98d6bc" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[904c5c7d-f8ab-447c-b4e0-d7c2648f8a50]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:35 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:36 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc Apr 10 10:43:36 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:36 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba" returned: 0 in 0.481s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488af1fd-bb61-4306-8d29-a26d7afe1da5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4ee213-8326-4ee2-82ce-b0492dd1ae29]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:36 devstack sudo[89801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 Apr 10 10:43:36 devstack sudo[89801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:36 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc" returned: 0 in 0.479s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:36 devstack sudo[89806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc Apr 10 10:43:36 devstack sudo[89806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:36 devstack sudo[89801]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5" returned: 0 in 0.461s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:36 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c Apr 10 10:43:36 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:36 devstack sudo[89806]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-55301236-42a8-432b-ae11-db124b98d6bc" returned: 0 in 0.399s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-55301236-42a8-432b-ae11-db124b98d6bc" released by "delete_volume" :: held 0.898s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created reservations ['3bd31c15-9642-47a4-8e70-8f54104bef4c', '0071f713-ccd1-4298-b036-9d7143711dc0', '70c7c7d2-affd-445b-8875-064fd301299b', 'a959d42f-3198-49fb-8534-5bd6330dc9eb'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:36 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:36 devstack sudo[89814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:36 devstack sudo[89814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-05105a9f-16ac-4f47-b565-952def9cbbc7-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-05105a9f-16ac-4f47-b565-952def9cbbc7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-quobyte-05105a9f-16ac-4f47-b565-952def9cbbc7" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-05105a9f-16ac-4f47-b565-952def9cbbc7" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:37 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7117d75-bba0-4fe8-9112-94f2cbc86805]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:37 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7 Apr 10 10:43:37 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:37 devstack sudo[89814]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:37 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.727s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:37 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:37 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Deleted volume successfully. Apr 10 10:43:37 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-26b23589-8de8-40ee-b638-2880f443312c tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-55301236-42a8-432b-ae11-db124b98d6bc-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:38 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7" returned: 0 in 1.138s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:38 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7 Apr 10 10:43:38 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:38 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c" returned: 0 in 2.089s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:38 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c98cc8c-6f9f-4d5e-9f0b-9914e63eccc7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:38 devstack sudo[89834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 Apr 10 10:43:38 devstack sudo[89834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:38 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:38 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-05105a9f-16ac-4f47-b565-952def9cbbc7" returned: 0 in 0.663s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:38 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-05105a9f-16ac-4f47-b565-952def9cbbc7" released by "delete_volume" :: held 1.838s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:38 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created reservations ['69d80d2f-d41f-4437-b4fc-422a72947a79', '8115147d-6136-4f29-a36a-6ab77017eb2c', '0f242066-e026-418a-a571-a26ea930b279', '19bbbdb1-ed3a-43c6-863a-606ae4f8e0aa'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:39 devstack sudo[89837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:39 devstack sudo[89837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_service.periodic_task [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82038) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:39 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:39 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-745ff0e7-6e5b-46f7-9b29-c3103328e3a0-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-745ff0e7-6e5b-46f7-9b29-c3103328e3a0-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-quobyte-745ff0e7-6e5b-46f7-9b29-c3103328e3a0" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-745ff0e7-6e5b-46f7-9b29-c3103328e3a0" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f493dcd-c22c-4e3b-a2ff-f1a817243680]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:39 devstack sudo[89834]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5" returned: 0 in 0.632s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:43:39 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Converted 1024.00 MB image at 489.90 MB/s Apr 10 10:43:39 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c is being set with open permissions: ugo+rw Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:39 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c Apr 10 10:43:39 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:39 devstack sudo[89844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0 Apr 10 10:43:39 devstack sudo[89844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:39 devstack sudo[89837]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.421s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:39 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Deleted volume successfully. Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-d4b57c09-8b2f-4ffb-9b36-d86a4c63687b tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-05105a9f-16ac-4f47-b565-952def9cbbc7-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:39 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.444s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-15e4b028-9aee-43f3-880f-b3c8d513ccda None None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:39 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c" returned: 0 in 0.441s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-59daea5a-6ac7-4564-82bc-d9638ac3125c" released by "_copy_volume_from_snapshot" :: held 4.162s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba-59daea5a-6ac7-4564-82bc-d9638ac3125c" released by "_create_volume_from_snapshot" :: held 4.197s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.219s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.330s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:33Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf49405-da56-4518-bd70-15789f4ae30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a125c3c94f6b4232936a0c0076dd5322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:33Z,use_quota=True,user_id='36bf7e8b274d4b1b92c0a577a1b3b966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Creating volume 7bf49405-da56-4518-bd70-15789f4ae30b {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:39 devstack sudo[89844]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:39 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0" returned: 0 in 0.508s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:39 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b 1073741824 Apr 10 10:43:39 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:39 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0 Apr 10 10:43:39 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9fa2c5b-da39-4b13-9e0f-c25a7da7bd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59daea5a-6ac7-4564-82bc-d9638ac3125c', 'volume_size': 1, 'snapshot_id': 'e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f00d1d-4530-4433-8c22-a0559db4b764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:39 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Volume volume-59daea5a-6ac7-4564-82bc-d9638ac3125c (59daea5a-6ac7-4564-82bc-d9638ac3125c): created successfully Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82f00d1d-4530-4433-8c22-a0559db4b764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:39 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Flow 'volume_create_manager' (db2d3612-2f01-4be6-97a7-ab17a7909e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:39 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4b9c58d3-ff6d-4884-b4f7-bd27a376d700 tempest-VolumeDependencyTests-671945497 None] Created volume successfully. Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Lock "cinder-e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-quobyte-488af1fd-bb61-4306-8d29-a26d7afe1da5" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-488af1fd-bb61-4306-8d29-a26d7afe1da5" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-quobyte-e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Deleting offline snapshot e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba of volume 488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] snapshot_file for this snap is: volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c26c5d-f22f-4fc4-9503-48b5c0157f8e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:40 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba Apr 10 10:43:40 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:40 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-745ff0e7-6e5b-46f7-9b29-c3103328e3a0" returned: 0 in 0.400s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-745ff0e7-6e5b-46f7-9b29-c3103328e3a0" released by "delete_volume" :: held 0.932s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created reservations ['b3baf479-8cbe-499d-a84d-67f5c8031a61', 'd719c632-1b46-4651-96a8-84396cd5bfd9', '19ca426d-524c-4adc-b1a7-7b57db798ad6', '4446eb76-f7f8-48ca-8150-a5fc7b6f44d1'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:40 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:40 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:40 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b 1073741824" returned: 0 in 0.528s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:40 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b Apr 10 10:43:40 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-8fdbeb71-c904-4a73-87ea-a1c8c98df40e-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-8fdbeb71-c904-4a73-87ea-a1c8c98df40e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-quobyte-8fdbeb71-c904-4a73-87ea-a1c8c98df40e" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-8fdbeb71-c904-4a73-87ea-a1c8c98df40e" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe45eab-2962-4f07-81b2-92d50251a280]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:40 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba" returned: 0 in 0.503s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488af1fd-bb61-4306-8d29-a26d7afe1da5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:43:40 devstack sudo[89869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e Apr 10 10:43:40 devstack sudo[89869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1250f816-844c-46f8-8c72-bae13e4501c7]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:40 devstack sudo[89873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 Apr 10 10:43:40 devstack sudo[89873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:40 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.481s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:40 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Deleted volume successfully. Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ee2172c5-f2f1-4246-a231-538d65147823 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-745ff0e7-6e5b-46f7-9b29-c3103328e3a0-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:40 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b" returned: 0 in 0.533s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.594s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b204e56f-21ee-4fa9-88ce-779b60980f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf49405-da56-4518-bd70-15789f4ae30b', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7860a5-599a-46f5-acc3-d19453c39485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Creating offline snapshot 81b26104-0dda-4126-845a-162e21de8c1c of volume 3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:43:40 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Volume volume-7bf49405-da56-4518-bd70-15789f4ae30b (7bf49405-da56-4518-bd70-15789f4ae30b): created successfully Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe7860a5-599a-46f5-acc3-d19453c39485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Flow 'volume_create_manager' (3d9de7b9-f948-4323-b54f-23cee2cd7907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[274ef67f-aaed-4643-a557-e997c3bcb077]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:40 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-bcc11fd4-7bd2-4fc4-b548-299c26a8bb67 tempest-CinderUnicodeTest-1343081640 None] Created volume successfully. Apr 10 10:43:40 devstack sudo[89869]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e" returned: 0 in 0.482s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:40 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:41 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e Apr 10 10:43:41 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:41 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 Apr 10 10:43:41 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:41 devstack sudo[89873]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5" returned: 0 in 0.535s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:41 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba Apr 10 10:43:41 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:41 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27" returned: 0 in 0.454s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:41 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8fdbeb71-c904-4a73-87ea-a1c8c98df40e" returned: 0 in 0.431s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-8fdbeb71-c904-4a73-87ea-a1c8c98df40e" released by "delete_volume" :: held 0.951s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:41 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c 1G Apr 10 10:43:41 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created reservations ['b0610aca-b316-4214-aa90-8cd7b61d7cfb', '31e98a11-20b9-45a8-8e19-c3205f437ae7', 'ed0d39c2-ad84-49da-bc1b-4436168a5895', '15630eaf-ae27-459a-89b7-3b5813f29793'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:41 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:41 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-49840fa2-cb17-45c9-90ae-af918b8b4403-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-49840fa2-cb17-45c9-90ae-af918b8b4403-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-quobyte-49840fa2-cb17-45c9-90ae-af918b8b4403" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-49840fa2-cb17-45c9-90ae-af918b8b4403" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3672b0be-7f78-4663-a9f5-08f67df0b072]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:41 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba" returned: 0 in 0.534s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:41 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba Apr 10 10:43:41 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:41 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403 Apr 10 10:43:41 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:41 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.454s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:41 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Deleted volume successfully. Apr 10 10:43:41 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-254d5412-cc0e-40d6-968b-b7a533a77723 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-8fdbeb71-c904-4a73-87ea-a1c8c98df40e-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:42 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c 1G" returned: 0 in 0.612s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:42 devstack sudo[89909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c Apr 10 10:43:42 devstack sudo[89909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:42 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403" returned: 0 in 0.579s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:42 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403 Apr 10 10:43:42 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:42 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Flow 'volume_create_manager' (0ef0fe54-740f-4d27-94b9-43448c0b456c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fbe650-087d-466f-a04a-6d07cfc7112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5.e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba" returned: 0 in 0.590s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fbe650-087d-466f-a04a-6d07cfc7112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-128944460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35471e65-e638-4e04-8f1b-ec73f6eabc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a125c3c94f6b4232936a0c0076dd5322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:42Z,use_quota=True,user_id='36bf7e8b274d4b1b92c0a577a1b3b966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6017b440-0906-42e9-ab58-c3b0313f788b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6017b440-0906-42e9-ab58-c3b0313f788b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca51f61b-3ee8-4d93-a22b-90aed4276f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca51f61b-3ee8-4d93-a22b-90aed4276f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35471e65-e638-4e04-8f1b-ec73f6eabc3f', 'volume_name': 'volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd52249-06bd-48e4-9fc4-11460a566e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecd52249-06bd-48e4-9fc4-11460a566e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfd2682-5878-413e-8f65-dbce34fc9774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:42 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Volume 35471e65-e638-4e04-8f1b-ec73f6eabc3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f', 'volume_size': 1} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba" released by "_delete_snapshot" :: held 2.246s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-488af1fd-bb61-4306-8d29-a26d7afe1da5" released by "delete_snapshot" :: held 2.261s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Created reservations ['5cf6e19d-5cd6-4092-a72f-430f748fb1fc', 'f4f30012-2934-4979-a9de-53409d2f6dd2', '41e47276-72c5-4043-9618-dbfd73e968dc', '0bb67409-bbcd-4070-8f0e-1c0ee8da92ba'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:42 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Delete snapshot completed successfully. Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-df9b8946-df2a-4284-b90f-8c256326c4ee tempest-VolumeDependencyTests-671945497 None] Lock "cinder-e05f2bc5-1492-475e-a9bd-7a0e7ab0ebba-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:42 devstack sudo[89909]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c" returned: 0 in 0.499s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:42 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c is being set with open permissions: ugo+rw Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:42 devstack sudo[89920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c Apr 10 10:43:42 devstack sudo[89920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:42 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-49840fa2-cb17-45c9-90ae-af918b8b4403" returned: 0 in 0.459s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-49840fa2-cb17-45c9-90ae-af918b8b4403" released by "delete_volume" :: held 1.069s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created reservations ['153e7bb7-39cf-4416-a3ea-10c18a371caa', '73401136-a98c-4253-a562-bd9282a87472', 'bc0e3ae6-8969-4555-bbee-bafb3e9f1fda', '3fe86a49-3cbc-4ee0-829a-5e450e6ac724'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:42 devstack sudo[89923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:42 devstack sudo[89923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:42 devstack sudo[89920]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c" returned: 0 in 0.413s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:42 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:42 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.info Apr 10 10:43:42 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:43 devstack sudo[89923]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.424s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:43 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Deleted volume successfully. Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5fa04e31-f227-4559-b5e3-1d354d6918f7 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-49840fa2-cb17-45c9-90ae-af918b8b4403-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-488af1fd-bb61-4306-8d29-a26d7afe1da5-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Lock "cinder-488af1fd-bb61-4306-8d29-a26d7afe1da5-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-quobyte-488af1fd-bb61-4306-8d29-a26d7afe1da5" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-488af1fd-bb61-4306-8d29-a26d7afe1da5" acquired by "delete_volume" :: waited 0.007s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f7844f-eedf-4a4f-adae-bd24a541b3a8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:43 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 Apr 10 10:43:43 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:43 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.info" returned: 0 in 0.421s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:43 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.info is being set with open permissions: ugo+rw Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:43 devstack sudo[89932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.info Apr 10 10:43:43 devstack sudo[89932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-fd358381-7a71-4f26-99b5-725373ae2ef8-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-fd358381-7a71-4f26-99b5-725373ae2ef8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-quobyte-bc2387ec-f7da-48e5-b91c-97a3bad6d882" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-bc2387ec-f7da-48e5-b91c-97a3bad6d882" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-quobyte-fd358381-7a71-4f26-99b5-725373ae2ef8" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:43 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5" returned: 0 in 0.478s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-fd358381-7a71-4f26-99b5-725373ae2ef8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Deleting offline snapshot fd358381-7a71-4f26-99b5-725373ae2ef8 of volume bc2387ec-f7da-48e5-b91c-97a3bad6d882 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:43:43 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5 Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] snapshot_file for this snap is: volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:43:43 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc7a091-c4bc-433e-9312-4f01d813890c]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:43 devstack sudo[89932]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.info" returned: 0 in 0.463s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.942s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.553s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-128944460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35471e65-e638-4e04-8f1b-ec73f6eabc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a125c3c94f6b4232936a0c0076dd5322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:42Z,use_quota=True,user_id='36bf7e8b274d4b1b92c0a577a1b3b966',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Creating volume 35471e65-e638-4e04-8f1b-ec73f6eabc3f {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:43 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:43 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:43 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 Apr 10 10:43:43 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:43 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f 1073741824 Apr 10 10:43:43 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:43 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ff4789c4-23aa-41b8-b89e-c4a34bb7afc4 tempest-SnapshotDependencyTests-1563621178 None] Create snapshot completed successfully Apr 10 10:43:44 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-488af1fd-bb61-4306-8d29-a26d7afe1da5" returned: 0 in 0.412s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-488af1fd-bb61-4306-8d29-a26d7afe1da5" released by "delete_volume" :: held 0.914s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Created reservations ['a40f1388-5112-4c28-95df-ef329d3fa6b7', '871f41b5-fcda-429c-9427-075bba517626', '78c75972-a079-4cd6-8f2d-d18a05d98b16', '1a88e8f6-737f-4253-9f1d-e109930133a8'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:44 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:44 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:44 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8" returned: 0 in 0.535s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e23696-e16a-48fa-b5a9-29caed8c9b11]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:44 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 Apr 10 10:43:44 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:44 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f 1073741824" returned: 0 in 0.555s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:44 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f Apr 10 10:43:44 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Flow 'volume_create_manager' (7977a96a-007b-42fc-bfa6-044bf99554c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15cc81a8-e562-4d1f-8d60-2328f2a4f418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15cc81a8-e562-4d1f-8d60-2328f2a4f418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-648816167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a10434b-5cb2-4c6d-a1f9-f74b5a73b358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a99750fa9114325bb75ef2b94a03cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:45Z,use_quota=True,user_id='b76722fa2882436982af60c684fc6283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc34cef-2f5f-475d-aad5-1dd9b5eb30a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fc34cef-2f5f-475d-aad5-1dd9b5eb30a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98209e0a-f513-4225-be14-c3c652ab2fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98209e0a-f513-4225-be14-c3c652ab2fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a10434b-5cb2-4c6d-a1f9-f74b5a73b358', 'volume_name': 'volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f283ed-5db9-49e6-94bb-959a308c0597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f283ed-5db9-49e6-94bb-959a308c0597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e21a54-11b4-4737-9308-3f0cd71bff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:44 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Volume 9a10434b-5cb2-4c6d-a1f9-f74b5a73b358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358', 'volume_size': 1} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:44 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.468s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:44 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Deleted volume successfully. Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-ceb4d3e1-bfbe-4521-a703-8875203aca8f tempest-VolumeDependencyTests-671945497 None] Lock "cinder-488af1fd-bb61-4306-8d29-a26d7afe1da5-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:44 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882" returned: 0 in 0.581s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:44 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:44 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 Apr 10 10:43:44 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:45 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f" returned: 0 in 0.567s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.327s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-648816167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a10434b-5cb2-4c6d-a1f9-f74b5a73b358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a99750fa9114325bb75ef2b94a03cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:45Z,use_quota=True,user_id='b76722fa2882436982af60c684fc6283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Creating volume 9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:45 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:45 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 1073741824 Apr 10 10:43:45 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bfd2682-5878-413e-8f65-dbce34fc9774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11b0ab0-f1a0-4395-8a53-57ab1c8c1690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Flow 'volume_create_manager' (e52cf8eb-3916-4d07-ba1a-207ea8e5e086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdb2ef1-288d-4088-a8f1-41631e85ae0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:45 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Volume volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f (35471e65-e638-4e04-8f1b-ec73f6eabc3f): created successfully Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f11b0ab0-f1a0-4395-8a53-57ab1c8c1690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Flow 'volume_create_manager' (0ef0fe54-740f-4d27-94b9-43448c0b456c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcdb2ef1-288d-4088-a8f1-41631e85ae0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b675774a-5a5f-47eb-a752-b5870a041851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09f6653a9d874ce390bad0d887ecb7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=81b26104-0dda-4126-845a-162e21de8c1c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:45Z,use_quota=True,user_id='41cf0995ff15488b96e9d7e0de7b024e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a362f0-b297-4a53-b0f5-7431a356050c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4a362f0-b297-4a53-b0f5-7431a356050c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9807a5-f974-4b4e-8afc-2154070ef942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c9807a5-f974-4b4e-8afc-2154070ef942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b675774a-5a5f-47eb-a752-b5870a041851', 'volume_name': 'volume-b675774a-5a5f-47eb-a752-b5870a041851', 'volume_size': 1, 'snapshot_id': '81b26104-0dda-4126-845a-162e21de8c1c'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6335b8-38cc-4316-8615-cea131a94991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6335b8-38cc-4316-8615-cea131a94991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23cac41c-8fce-40e1-b591-c067e0cb363e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:45 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Volume b675774a-5a5f-47eb-a752-b5870a041851: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b675774a-5a5f-47eb-a752-b5870a041851', 'volume_size': 1, 'snapshot_id': '81b26104-0dda-4126-845a-162e21de8c1c'} Apr 10 10:43:45 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-29c09207-bdfe-4feb-92df-2e10f1a87760 tempest-CinderUnicodeTest-1343081640 None] Created volume successfully. Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:45 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8" returned: 0 in 0.485s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:45 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8 Apr 10 10:43:45 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:45 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 1073741824" returned: 0 in 0.516s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:45 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 Apr 10 10:43:45 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:45 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882.fd358381-7a71-4f26-99b5-725373ae2ef8" returned: 0 in 0.479s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-fd358381-7a71-4f26-99b5-725373ae2ef8" released by "_delete_snapshot" :: held 2.131s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-bc2387ec-f7da-48e5-b91c-97a3bad6d882" released by "delete_snapshot" :: held 2.157s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created reservations ['f1ae9e42-4d5f-454a-b22f-f23bd01b584b', '0f97f603-f413-479f-bdbd-640372fc9d72', 'b704a48d-9bed-4e35-9ee3-bce6e699bcce', 'e1d19e49-c27e-4973-ae5c-04721afced7d'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:45 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Delete snapshot completed successfully. Apr 10 10:43:45 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b8316194-0963-441c-8d8c-d5468ce7e691 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-fd358381-7a71-4f26-99b5-725373ae2ef8-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:46 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358" returned: 0 in 0.404s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.845s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "cinder-quobyte-81b26104-0dda-4126-845a-162e21de8c1c-b675774a-5a5f-47eb-a752-b5870a041851" by "_create_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53e21a54-11b4-4737-9308-3f0cd71bff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4ed8d7-659d-4ff8-a755-0be1b5bc5157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:46 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Volume volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 (9a10434b-5cb2-4c6d-a1f9-f74b5a73b358): created successfully Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da4ed8d7-659d-4ff8-a755-0be1b5bc5157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Flow 'volume_create_manager' (7977a96a-007b-42fc-bfa6-044bf99554c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-81b26104-0dda-4126-845a-162e21de8c1c-b675774a-5a5f-47eb-a752-b5870a041851" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Creating volume b675774a-5a5f-47eb-a752-b5870a041851 from snapshot 81b26104-0dda-4126-845a-162e21de8c1c {{(pid=82038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "cinder-quobyte-b675774a-5a5f-47eb-a752-b5870a041851" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:46 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b1a7e706-2296-4f12-9da3-7fbdbf754428 tempest-VolumeDependencyTests-671945497 None] Created volume successfully. Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-b675774a-5a5f-47eb-a752-b5870a041851" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] snapshot: 81b26104-0dda-4126-845a-162e21de8c1c, volume: b675774a-5a5f-47eb-a752-b5870a041851, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[93cdb40e-7d58-4c2b-af6d-3fcf4f85e9f0]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:46 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c Apr 10 10:43:46 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:46 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c" returned: 0 in 0.457s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bafff8-10af-4918-860e-07335b92853b]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:46 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 Apr 10 10:43:46 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-bc2387ec-f7da-48e5-b91c-97a3bad6d882-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-bc2387ec-f7da-48e5-b91c-97a3bad6d882-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "cinder-quobyte-bc2387ec-f7da-48e5-b91c-97a3bad6d882" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-bc2387ec-f7da-48e5-b91c-97a3bad6d882" acquired by "delete_volume" :: waited 0.020s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b9d8ad-dd6e-4413-a442-2d949e061162]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:46 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Flow 'volume_create_manager' (3c219eaa-e406-4478-8e4d-88ceaf4494b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca62427-c6cc-4445-8b3c-5a2b81cabbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dca62427-c6cc-4445-8b3c-5a2b81cabbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1894046901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd551de-352f-49c7-bbc7-ffbbbd9273b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a99750fa9114325bb75ef2b94a03cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=9a10434b-5cb2-4c6d-a1f9-f74b5a73b358,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:47Z,use_quota=True,user_id='b76722fa2882436982af60c684fc6283',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65814f0-0fd6-4ed2-b768-b8372ee851ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65814f0-0fd6-4ed2-b768-b8372ee851ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9e148f-3c3c-44e9-b990-a3b42f00ffec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:47 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:47 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 Apr 10 10:43:47 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9e148f-3c3c-44e9-b990-a3b42f00ffec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'cfd551de-352f-49c7-bbc7-ffbbbd9273b9', 'volume_name': 'volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9', 'volume_size': 1, 'source_volid': '9a10434b-5cb2-4c6d-a1f9-f74b5a73b358', 'source_volstatus': 'available'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b08a5d1-66aa-4ec4-8c97-9eaca1a28ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b08a5d1-66aa-4ec4-8c97-9eaca1a28ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e3e67b-6e8d-4e58-a106-3039f16c40a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:47 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Volume cfd551de-352f-49c7-bbc7-ffbbbd9273b9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9', 'volume_size': 1, 'source_volid': '9a10434b-5cb2-4c6d-a1f9-f74b5a73b358', 'source_volstatus': 'available'} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27" returned: 0 in 0.522s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:47 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 Apr 10 10:43:47 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:47 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882" returned: 0 in 0.478s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:47 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:47 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882 Apr 10 10:43:47 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:48 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-bc2387ec-f7da-48e5-b91c-97a3bad6d882" returned: 0 in 0.795s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:48 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-quobyte-bc2387ec-f7da-48e5-b91c-97a3bad6d882" released by "delete_volume" :: held 1.311s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:48 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Created reservations ['8d7ff236-04a9-4c16-822d-0d79260a0bf5', '9255caed-9d04-496d-9567-4c05a30842c0', 'e450ecfa-710f-49a7-893a-3a2944b9d178', '93a03db1-fab3-4e2e-a55e-f8072d84cc9a'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:48 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:48 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:48 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:48 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:48 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851" returned: 0 in 1.910s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:49 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c40148d-a4e1-46a4-a8d0-21e177682719]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:49 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 Apr 10 10:43:49 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:49 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.764s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:49 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:49 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Deleted volume successfully. Apr 10 10:43:49 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-bf485d91-a901-4026-82af-d5cb579bd228 tempest-CreateVolumesFromSnapshotTest-1835383760 None] Lock "cinder-bc2387ec-f7da-48e5-b91c-97a3bad6d882-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:49 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27" returned: 0 in 0.676s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:49 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:43:49 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Converted 1024.00 MB image at 535.64 MB/s Apr 10 10:43:49 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 is being set with open permissions: ugo+rw Apr 10 10:43:49 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:49 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 Apr 10 10:43:49 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:50 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851" returned: 0 in 0.425s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-b675774a-5a5f-47eb-a752-b5870a041851" released by "_copy_volume_from_snapshot" :: held 4.056s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-81b26104-0dda-4126-845a-162e21de8c1c-b675774a-5a5f-47eb-a752-b5870a041851" released by "_create_volume_from_snapshot" :: held 4.077s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.109s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.523s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Creating offline snapshot ddfc8860-093f-44d0-8780-f072396e8bd2 of volume 35471e65-e638-4e04-8f1b-ec73f6eabc3f {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e3a579-f4cd-47dc-b777-dc8c42622179]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23cac41c-8fce-40e1-b591-c067e0cb363e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b675774a-5a5f-47eb-a752-b5870a041851', 'volume_size': 1, 'snapshot_id': '81b26104-0dda-4126-845a-162e21de8c1c'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5d7724-c158-4cb3-97ac-7c8f88af3e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:50 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Volume volume-b675774a-5a5f-47eb-a752-b5870a041851 (b675774a-5a5f-47eb-a752-b5870a041851): created successfully Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5d7724-c158-4cb3-97ac-7c8f88af3e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Flow 'volume_create_manager' (e52cf8eb-3916-4d07-ba1a-207ea8e5e086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:50 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-88d3d738-9bee-48f7-85fb-119acdceeaa4 tempest-SnapshotDependencyTests-1563621178 None] Created volume successfully. Apr 10 10:43:50 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f Apr 10 10:43:50 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "cinder-81b26104-0dda-4126-845a-162e21de8c1c-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-81b26104-0dda-4126-845a-162e21de8c1c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "cinder-quobyte-3f223e8c-5bd7-4504-b736-50eb35e8ef27" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-3f223e8c-5bd7-4504-b736-50eb35e8ef27" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "cinder-quobyte-81b26104-0dda-4126-845a-162e21de8c1c" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-81b26104-0dda-4126-845a-162e21de8c1c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Deleting offline snapshot 81b26104-0dda-4126-845a-162e21de8c1c of volume 3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] snapshot_file for this snap is: volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bc0111-4fce-4358-8037-3ed21760efcd]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:50 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c Apr 10 10:43:50 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:50 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f" returned: 0 in 0.612s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:50 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:50 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 1G Apr 10 10:43:50 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:51 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c" returned: 0 in 0.614s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73c8adf-b1a4-40ba-ba22-e03e35485176]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:51 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 Apr 10 10:43:51 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (23a3cadb-9901-4f05-bfab-6382b8a8bcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc374d0-5983-4a71-a079-89235a38c718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fc374d0-5983-4a71-a079-89235a38c718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-738326865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f97125-c364-4302-a3f2-faae3b1caa66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:51Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b019f963-815d-459d-89f0-e66fe331fb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b019f963-815d-459d-89f0-e66fe331fb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:51 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c534c2-c0c7-48de-82cf-4cf2107a403c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c534c2-c0c7-48de-82cf-4cf2107a403c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f97125-c364-4302-a3f2-faae3b1caa66', 'volume_name': 'volume-12f97125-c364-4302-a3f2-faae3b1caa66', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d1e74f-166c-4d94-b574-45f664b8fc9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8d1e74f-166c-4d94-b574-45f664b8fc9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f39adc-9be0-47ab-a57f-5b8ea37b367f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:43:51 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume 12f97125-c364-4302-a3f2-faae3b1caa66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f97125-c364-4302-a3f2-faae3b1caa66', 'volume_size': 1} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 1G" returned: 0 in 0.594s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:51 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 Apr 10 10:43:51 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:51 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27" returned: 0 in 0.564s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:51 devstack sudo[90049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c Apr 10 10:43:51 devstack sudo[90049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:51 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2" returned: 0 in 0.467s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:51 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 is being set with open permissions: ugo+rw Apr 10 10:43:51 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:51 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 Apr 10 10:43:51 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:52 devstack sudo[90049]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c" returned: 0 in 0.495s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:52 devstack sudo[90060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c Apr 10 10:43:52 devstack sudo[90060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:52 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2" returned: 0 in 0.396s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:52 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.info Apr 10 10:43:52 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:52 devstack sudo[90060]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27.81b26104-0dda-4126-845a-162e21de8c1c" returned: 0 in 0.415s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-81b26104-0dda-4126-845a-162e21de8c1c" released by "_delete_snapshot" :: held 2.143s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-3f223e8c-5bd7-4504-b736-50eb35e8ef27" released by "delete_snapshot" :: held 2.153s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Created reservations ['ee43c38b-1f6f-4689-8d21-d7e5a6d3c272', 'cb3fb9a9-b089-4963-9e1f-85e3e0db4266', '186df849-0fdd-4ef0-aeb1-5b8340aeb219', '1f716013-f013-4a8c-a6e2-c4b0a57a4cda'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:52 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Delete snapshot completed successfully. Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-855d8f52-b513-4500-b3b6-8ddf139ab0c7 tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-81b26104-0dda-4126-845a-162e21de8c1c-delete_snapshot" released by "delete_snapshot" :: held 2.242s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:52 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.info" returned: 0 in 0.433s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:52 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.info is being set with open permissions: ugo+rw Apr 10 10:43:52 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:52 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.info Apr 10 10:43:52 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:53 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.info" returned: 0 in 0.394s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.959s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.991s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:53 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Cloning volume 9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 to volume cfd551de-352f-49c7-bbc7-ffbbbd9273b9 Apr 10 10:43:53 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-7fa5d14d-1821-4b8a-98e3-d08558f6ed5c tempest-CinderUnicodeTest-1343081640 None] Create snapshot completed successfully Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Creating offline snapshot d066e9a1-ef03-4217-b0c8-56eb53af32e5 of volume 9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9bd08f-9699-40ec-84b6-5653a7792229]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:53 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 Apr 10 10:43:53 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "cinder-3f223e8c-5bd7-4504-b736-50eb35e8ef27-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-3f223e8c-5bd7-4504-b736-50eb35e8ef27-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "cinder-quobyte-3f223e8c-5bd7-4504-b736-50eb35e8ef27" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-3f223e8c-5bd7-4504-b736-50eb35e8ef27" acquired by "delete_volume" :: waited 0.019s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[81185252-e8e4-4a7c-8a86-c0f6588cefae]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:53 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358" returned: 0 in 0.494s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 1G {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:53 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 1G Apr 10 10:43:53 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:53 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 Apr 10 10:43:53 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "cinder-ddfc8860-093f-44d0-8780-f072396e8bd2-delete_snapshot" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-ddfc8860-093f-44d0-8780-f072396e8bd2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "cinder-quobyte-35471e65-e638-4e04-8f1b-ec73f6eabc3f" by "delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-quobyte-35471e65-e638-4e04-8f1b-ec73f6eabc3f" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "cinder-quobyte-ddfc8860-093f-44d0-8780-f072396e8bd2" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-quobyte-ddfc8860-093f-44d0-8780-f072396e8bd2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Deleting offline snapshot ddfc8860-093f-44d0-8780-f072396e8bd2 of volume 35471e65-e638-4e04-8f1b-ec73f6eabc3f {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] snapshot_file for this snap is: volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e31da3d-911c-4d0b-8c2a-e4d280983bd0]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:53 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:53 devstack sudo[90079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 Apr 10 10:43:53 devstack sudo[90079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:54 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27" returned: 0 in 0.497s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:54 devstack sudo[90087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27 Apr 10 10:43:54 devstack sudo[90087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:54 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 1G" returned: 0 in 0.490s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:54 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 Apr 10 10:43:54 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:54 devstack sudo[90079]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2" returned: 0 in 0.497s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22bf9ef-903f-4101-b647-c623ab237cf2]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:54 devstack sudo[90094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f Apr 10 10:43:54 devstack sudo[90094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:54 devstack sudo[90087]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-3f223e8c-5bd7-4504-b736-50eb35e8ef27" returned: 0 in 0.422s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-3f223e8c-5bd7-4504-b736-50eb35e8ef27" released by "delete_volume" :: held 0.947s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:54 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 -F qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5" returned: 0 in 0.437s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:54 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 is being set with open permissions: ugo+rw Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Created reservations ['a5d13292-83c3-43ef-b294-5a3366e4b2e7', '001c3dfd-6e29-403a-90e5-50f0c3a502c5', '8eebdfab-7f35-405c-9c63-6cd68aec3357', 'af4ad499-bfc7-453d-a015-7f0aff2f2554'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:54 devstack sudo[90100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 Apr 10 10:43:54 devstack sudo[90100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "cinder-b675774a-5a5f-47eb-a752-b5870a041851-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:54 devstack sudo[90102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:54 devstack sudo[90102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-b675774a-5a5f-47eb-a752-b5870a041851-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "cinder-quobyte-b675774a-5a5f-47eb-a752-b5870a041851" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-b675774a-5a5f-47eb-a752-b5870a041851" acquired by "delete_volume" :: waited 0.006s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcb7d45-e208-4fe8-81dd-a32ff3391b02]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:54 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 Apr 10 10:43:54 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:54 devstack sudo[90094]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f" returned: 0 in 0.508s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:54 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 Apr 10 10:43:54 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:54 devstack sudo[90100]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:54 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5" returned: 0 in 0.442s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:55 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.info Apr 10 10:43:55 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:55 devstack sudo[90102]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.477s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:55 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Deleted volume successfully. Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-332568b7-497b-45f6-8c79-b174230d279f tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-3f223e8c-5bd7-4504-b736-50eb35e8ef27-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:55 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851" returned: 0 in 0.507s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:55 devstack sudo[90118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851 Apr 10 10:43:55 devstack sudo[90118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:55 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2" returned: 0 in 0.515s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:55 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.info" returned: 0 in 0.448s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:55 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.info is being set with open permissions: ugo+rw Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.info {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:55 devstack sudo[90124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2 Apr 10 10:43:55 devstack sudo[90124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:55 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.info Apr 10 10:43:55 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:55 devstack sudo[90118]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-b675774a-5a5f-47eb-a752-b5870a041851" returned: 0 in 0.444s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-quobyte-b675774a-5a5f-47eb-a752-b5870a041851" released by "delete_volume" :: held 0.972s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Created reservations ['f67d1427-47af-4b2d-8d6c-b1bb795d878e', 'e4337a2f-3709-4aeb-ac5f-01404cca2dac', '6177bfce-e248-4cfc-9842-7353f0195979', 'c9170ee8-04f1-42c4-8749-b2f3174be0f2'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:55 devstack sudo[90130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:55 devstack sudo[90130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:55 devstack sudo[90124]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f.ddfc8860-093f-44d0-8780-f072396e8bd2" returned: 0 in 0.420s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-quobyte-ddfc8860-093f-44d0-8780-f072396e8bd2" released by "_delete_snapshot" :: held 2.008s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-quobyte-35471e65-e638-4e04-8f1b-ec73f6eabc3f" released by "delete_snapshot" :: held 2.017s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:55 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.info" returned: 0 in 0.480s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-quobyte-cfd551de-352f-49c7-bbc7-ffbbbd9273b9" by "_copy_volume_from_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Created reservations ['4e2ce83d-1a2c-4570-b7a6-2cf699116fb5', '026626d2-025a-4002-8579-a4214d8b671e', '7d3d029c-a10f-4a82-b8de-e38fd9320700', 'a412dec0-01c9-4499-9b81-c2c514f9d254'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-cfd551de-352f-49c7-bbc7-ffbbbd9273b9" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] snapshot: d066e9a1-ef03-4217-b0c8-56eb53af32e5, volume: cfd551de-352f-49c7-bbc7-ffbbbd9273b9, {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:55 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e4f071-1c08-4fed-b422-acea2c2c75fc]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:56 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Delete snapshot completed successfully. Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-7a2117e9-d1aa-46b9-a00d-2335905597b9 tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-ddfc8860-093f-44d0-8780-f072396e8bd2-delete_snapshot" released by "delete_snapshot" :: held 2.152s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:56 devstack sudo[90133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 Apr 10 10:43:56 devstack sudo[90133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:56 devstack sudo[90130]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.460s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:43:56 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Deleted volume successfully. Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-39cdbb07-57f8-4cf0-b034-8943dd476acd tempest-SnapshotDependencyTests-1563621178 None] Lock "cinder-b675774a-5a5f-47eb-a752-b5870a041851-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:56 devstack sudo[90133]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5" returned: 0 in 0.546s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] will copy from snapshot at /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Creating direct copy from snapshot {{(pid=82038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b261048-2493-4af6-9913-5b555e34208a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:56 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:56 devstack sudo[90139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 Apr 10 10:43:56 devstack sudo[90139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "cinder-35471e65-e638-4e04-8f1b-ec73f6eabc3f-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-35471e65-e638-4e04-8f1b-ec73f6eabc3f-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "cinder-quobyte-35471e65-e638-4e04-8f1b-ec73f6eabc3f" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-quobyte-35471e65-e638-4e04-8f1b-ec73f6eabc3f" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6be023-b6c3-44fb-b5b8-e81b662305f2]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:57 devstack sudo[90139]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358" returned: 0 in 0.578s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG cinder.utils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Path /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 not found in is_blk_device check {{(pid=82038) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:57 devstack sudo[90146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 Apr 10 10:43:57 devstack sudo[90146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:57 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f Apr 10 10:43:57 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:57 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f" returned: 0 in 0.629s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:57 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:57 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f Apr 10 10:43:57 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:59 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-35471e65-e638-4e04-8f1b-ec73f6eabc3f" returned: 0 in 1.315s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-quobyte-35471e65-e638-4e04-8f1b-ec73f6eabc3f" released by "delete_volume" :: held 1.992s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Created reservations ['a5b020a1-6c84-476a-835b-78b026b0f44c', 'fcd98660-fbb1-4dae-aa03-9c98561361fa', '285e01ed-8152-42bf-bf76-bd6dc0d3a25a', '004d9df5-dc03-4767-956c-9ae2bab129c1'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:59 devstack sudo[90165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:43:59 devstack sudo[90165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "cinder-7bf49405-da56-4518-bd70-15789f4ae30b-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-7bf49405-da56-4518-bd70-15789f4ae30b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:59 devstack sudo[90146]: pam_unix(sudo:session): session closed for user root Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9" returned: 0 in 2.455s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "cinder-quobyte-7bf49405-da56-4518-bd70-15789f4ae30b" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23ea567-331e-421d-bc2e-8094f5f14340]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-quobyte-7bf49405-da56-4518-bd70-15789f4ae30b" acquired by "delete_volume" :: waited 0.021s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1d208e-465a-4319-ba09-f94befad155b]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:43:59 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:43:59 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b Apr 10 10:43:59 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:43:59 devstack sudo[90168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 Apr 10 10:43:59 devstack sudo[90168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:00 devstack sudo[90165]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.573s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:00 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Deleted volume successfully. Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-83137031-67a9-440d-ab6d-22b021c668ce tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-35471e65-e638-4e04-8f1b-ec73f6eabc3f-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:00 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b" returned: 0 in 0.525s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:00 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b Apr 10 10:44:00 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:00 devstack sudo[90168]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358" returned: 0 in 0.754s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.image.image_utils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Image conversion details: src /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358, size 1024.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 {{(pid=82038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 10:44:00 devstack cinder-volume[82038]: INFO cinder.image.image_utils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Converted 1024.00 MB image at 416.86 MB/s Apr 10 10:44:00 devstack cinder-volume[82038]: WARNING cinder.volume.drivers.remotefs [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 is being set with open permissions: ugo+rw Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:00 devstack sudo[90181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 Apr 10 10:44:00 devstack sudo[90181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:00 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-7bf49405-da56-4518-bd70-15789f4ae30b" returned: 0 in 0.433s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-quobyte-7bf49405-da56-4518-bd70-15789f4ae30b" released by "delete_volume" :: held 0.993s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Created reservations ['628695c3-bc0a-490f-9abc-00162378bf6b', '1f98bcc1-7cb5-4f36-a129-6210ad9744b7', '15ad973e-8ec4-4964-9873-7fd4ab77dedd', '202592e9-7592-482d-a610-8592cbd876f0'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:00 devstack sudo[90184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:44:00 devstack sudo[90184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:00 devstack sudo[90181]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9" returned: 0 in 0.521s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-cfd551de-352f-49c7-bbc7-ffbbbd9273b9" released by "_copy_volume_from_snapshot" :: held 4.925s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-quobyte-d066e9a1-ef03-4217-b0c8-56eb53af32e5" by "_delete_snapshot" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-d066e9a1-ef03-4217-b0c8-56eb53af32e5" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Deleting offline snapshot d066e9a1-ef03-4217-b0c8-56eb53af32e5 of volume 9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] snapshot_file for this snap is: volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 {{(pid=82038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77bfaf7-b460-4f24-ae27-b128f8714c65]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:00 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:01 devstack sudo[90187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 Apr 10 10:44:01 devstack sudo[90187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:01 devstack sudo[90184]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.524s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:01 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:01 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Deleted volume successfully. Apr 10 10:44:01 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-f17f7e23-d191-49be-9fa9-c18ad57dcf93 tempest-CinderUnicodeTest-1343081640 None] Lock "cinder-7bf49405-da56-4518-bd70-15789f4ae30b-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:01 devstack sudo[90187]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5" returned: 0 in 0.676s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:01 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 10:44:01 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d6a116-4d4d-4f37-b862-0fbf8eced8d2]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:01 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:01 devstack sudo[90228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 Apr 10 10:44:01 devstack sudo[90228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:02 devstack sudo[90228]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358" returned: 0 in 0.592s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:02 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 Apr 10 10:44:02 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:02 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5" returned: 0 in 0.482s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:02 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:02 devstack sudo[90240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5 Apr 10 10:44:02 devstack sudo[90240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:03 devstack sudo[90240]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358.d066e9a1-ef03-4217-b0c8-56eb53af32e5" returned: 0 in 0.486s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-d066e9a1-ef03-4217-b0c8-56eb53af32e5" released by "_delete_snapshot" :: held 2.286s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.141s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.885s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-738326865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f97125-c364-4302-a3f2-faae3b1caa66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:43:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:43:51Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Creating volume 12f97125-c364-4302-a3f2-faae3b1caa66 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:44:03 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9e3e67b-6e8d-4e58-a106-3039f16c40a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9', 'volume_size': 1, 'source_volid': '9a10434b-5cb2-4c6d-a1f9-f74b5a73b358', 'source_volstatus': 'available'}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:03 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66 1073741824 Apr 10 10:44:03 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acead1c-c118-4a1a-8ace-4caa2d37d51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:03 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Volume volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 (cfd551de-352f-49c7-bbc7-ffbbbd9273b9): created successfully Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0acead1c-c118-4a1a-8ace-4caa2d37d51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Flow 'volume_create_manager' (3c219eaa-e406-4478-8e4d-88ceaf4494b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:03 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-16656c85-2400-4dd5-b3e7-0874a80934a7 tempest-VolumeDependencyTests-671945497 None] Created volume successfully. Apr 10 10:44:03 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66 1073741824" returned: 0 in 0.516s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:03 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:03 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66 Apr 10 10:44:03 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Lock "cinder-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-quobyte-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358" acquired by "delete_volume" :: waited 0.011s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26bea6c-175b-4b8a-8016-c4d330bd8bd8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:04 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 Apr 10 10:44:04 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:04 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66" returned: 0 in 0.454s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0f39adc-9be0-47ab-a57f-5b8ea37b367f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f97125-c364-4302-a3f2-faae3b1caa66', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6755fed5-837e-4064-b3e5-17c8e6b591e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:04 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume volume-12f97125-c364-4302-a3f2-faae3b1caa66 (12f97125-c364-4302-a3f2-faae3b1caa66): created successfully Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6755fed5-837e-4064-b3e5-17c8e6b591e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (23a3cadb-9901-4f05-bfab-6382b8a8bcd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:04 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-e1883c24-03c4-4d72-aee6-e47f4dbc3521 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created volume successfully. Apr 10 10:44:04 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358" returned: 0 in 0.451s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:04 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358 Apr 10 10:44:04 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:04 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358" returned: 0 in 0.380s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358" released by "delete_volume" :: held 0.857s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Created reservations ['6e1c6a93-50e9-4405-adf7-8342be2229ca', '8797f889-52d3-4aec-a2af-bbed8210a204', 'ec50212e-5502-4b9e-8b1b-66c3a30c1578', '7d6d43c6-2fea-483f-9d42-04d19a3b32fd'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:44:04 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:05 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:44:05 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-cfd551de-352f-49c7-bbc7-ffbbbd9273b9-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-cfd551de-352f-49c7-bbc7-ffbbbd9273b9-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-quobyte-cfd551de-352f-49c7-bbc7-ffbbbd9273b9" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-cfd551de-352f-49c7-bbc7-ffbbbd9273b9" acquired by "delete_volume" :: waited 0.006s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1196504d-fa5f-4062-aeef-51465b0cb666]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:05 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 Apr 10 10:44:05 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (7bf0b201-85fd-4bac-a9a7-60431e4de45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5cd9bc-529a-4288-b06d-f89255cb79f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed5cd9bc-529a-4288-b06d-f89255cb79f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-108138035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7ac5d1-7ba7-4464-ad43-7c75620b5620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:44:05Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb84420-8f6d-4f4e-8e82-12f9db53197e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eb84420-8f6d-4f4e-8e82-12f9db53197e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ded417-a436-4895-ad8c-f7447649f444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ded417-a436-4895-ad8c-f7447649f444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b7ac5d1-7ba7-4464-ad43-7c75620b5620', 'volume_name': 'volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023f1ca5-c573-4774-bb46-fd5127f05e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023f1ca5-c573-4774-bb46-fd5127f05e0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79ce07b-1c65-4041-912e-d68ac691bfaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume 9b7ac5d1-7ba7-4464-ad43-7c75620b5620: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620', 'volume_size': 1} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-108138035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b7ac5d1-7ba7-4464-ad43-7c75620b5620,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:44:05Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Creating volume 9b7ac5d1-7ba7-4464-ad43-7c75620b5620 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:44:05 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:05 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.429s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:05 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Deleted volume successfully. Apr 10 10:44:05 devstack sudo[90267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620 1073741824 Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-03ace80e-f06a-4596-ad63-865fd457764d tempest-VolumeDependencyTests-671945497 None] Lock "cinder-9a10434b-5cb2-4c6d-a1f9-f74b5a73b358-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:05 devstack sudo[90267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (fc30b249-ba30-4952-b17e-fd9d5e3d428e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa78220-8d9c-4a6f-81f9-c54bcd34d7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaa78220-8d9c-4a6f-81f9-c54bcd34d7d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1150042464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e37938-8488-4a34-a955-302e53fd8eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:44:06Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a990e7a-fb5c-4af4-9945-865a8ea1e7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a990e7a-fb5c-4af4-9945-865a8ea1e7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c08703-c4ff-4a0e-8d25-6a36491a89ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c08703-c4ff-4a0e-8d25-6a36491a89ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86e37938-8488-4a34-a955-302e53fd8eea', 'volume_name': 'volume-86e37938-8488-4a34-a955-302e53fd8eea', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233d113b-ff05-4fa0-8d6c-f764c57467ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233d113b-ff05-4fa0-8d6c-f764c57467ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb702d3-8361-4308-a717-072ec15a90a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume 86e37938-8488-4a34-a955-302e53fd8eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86e37938-8488-4a34-a955-302e53fd8eea', 'volume_size': 1} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (866c9193-0d40-4d71-b133-44b619d107c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab772d86-4b64-421c-8c56-2e8c4ab35d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab772d86-4b64-421c-8c56-2e8c4ab35d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1804997084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084c71a0-c413-4bc7-837c-8436aa84b0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:44:06Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f00380a-669e-4983-a306-69705d6e8225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f00380a-669e-4983-a306-69705d6e8225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32402e31-13d5-4f0d-b945-31b735239129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32402e31-13d5-4f0d-b945-31b735239129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084c71a0-c413-4bc7-837c-8436aa84b0c5', 'volume_name': 'volume-084c71a0-c413-4bc7-837c-8436aa84b0c5', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f24688-7fb7-4d23-aad4-e90bb5fcedb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f24688-7fb7-4d23-aad4-e90bb5fcedb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6c2711-4fcc-49c1-afa6-f4ba048d4e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:05 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume 084c71a0-c413-4bc7-837c-8436aa84b0c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084c71a0-c413-4bc7-837c-8436aa84b0c5', 'volume_size': 1} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9" returned: 0 in 0.579s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:05 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9 Apr 10 10:44:05 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (20114418-551a-47cc-923c-40ac668f8023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:05 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35832ed-8288-43ba-9da8-bed9018b639a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35832ed-8288-43ba-9da8-bed9018b639a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2126607580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b13d4a3-6f12-4e38-ad7a-56cb486b6672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:44:06Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2619fef0-a8d3-4b84-ada5-6ffab6bc0483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2619fef0-a8d3-4b84-ada5-6ffab6bc0483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf23bf3d-d553-4331-b5dc-65a2f1df7d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf23bf3d-d553-4331-b5dc-65a2f1df7d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b13d4a3-6f12-4e38-ad7a-56cb486b6672', 'volume_name': 'volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59eb4ea6-772f-47b2-a59c-3a3091f0345d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59eb4ea6-772f-47b2-a59c-3a3091f0345d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:06 devstack sudo[90267]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b00a3bb-0ab4-403e-a927-03c6c40c2737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume 8b13d4a3-6f12-4e38-ad7a-56cb486b6672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672', 'volume_size': 1} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620 1073741824" returned: 0 in 0.629s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:06 devstack sudo[90277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620 Apr 10 10:44:06 devstack sudo[90277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.flows.manager.create_volume [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (ae8d8f48-6722-4a34-b200-3a6a4ec8f031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0fc6e9-81c9-4f0a-81de-ca641870d104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0fc6e9-81c9-4f0a-81de-ca641870d104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091377346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6749940b-1d29-485f-a6fe-0988d871c557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:44:06Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cd2959-169b-4c77-b2ff-dae71a5abca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61cd2959-169b-4c77-b2ff-dae71a5abca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8d58f0-8b54-4499-8bc6-f55654e13aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d8d58f0-8b54-4499-8bc6-f55654e13aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6749940b-1d29-485f-a6fe-0988d871c557', 'volume_name': 'volume-6749940b-1d29-485f-a6fe-0988d871c557', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7719f23-8fcd-4f33-a3f4-79bb118631ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7719f23-8fcd-4f33-a3f4-79bb118631ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffa5c92-6733-4642-a952-08a915d24d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume 6749940b-1d29-485f-a6fe-0988d871c557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6749940b-1d29-485f-a6fe-0988d871c557', 'volume_size': 1} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:06 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-cfd551de-352f-49c7-bbc7-ffbbbd9273b9" returned: 0 in 0.479s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-cfd551de-352f-49c7-bbc7-ffbbbd9273b9" released by "delete_volume" :: held 1.091s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Created reservations ['cddf32c6-7bf1-46d6-9be1-558c57a44da1', 'f602abf3-1de9-4232-9520-27efd7bdb819', 'e30720de-aa2b-4233-9efe-31993b088512', '48890df0-e7b6-442c-85b6-cecbadd74c5d'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:06 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:44:06 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:06 devstack sudo[90277]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620" returned: 0 in 0.454s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1150042464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86e37938-8488-4a34-a955-302e53fd8eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:44:06Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Creating volume 86e37938-8488-4a34-a955-302e53fd8eea {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:44:06 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e79ce07b-1c65-4041-912e-d68ac691bfaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:06 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea 1073741824 Apr 10 10:44:06 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967bc461-e870-4b0e-8781-31024d892c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:06 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620 (9b7ac5d1-7ba7-4464-ad43-7c75620b5620): created successfully Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (967bc461-e870-4b0e-8781-31024d892c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (7bf0b201-85fd-4bac-a9a7-60431e4de45b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:06 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4404408b-3d0c-4049-9b9c-4fb6824ac3a5 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created volume successfully. Apr 10 10:44:06 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.415s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:06 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Deleted volume successfully. Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-9829ab07-c849-4ab3-a17f-b77202abc331 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-cfd551de-352f-49c7-bbc7-ffbbbd9273b9-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:06 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:06 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea 1073741824" returned: 0 in 0.465s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:07 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea Apr 10 10:44:07 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-59daea5a-6ac7-4564-82bc-d9638ac3125c-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-59daea5a-6ac7-4564-82bc-d9638ac3125c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "cinder-quobyte-59daea5a-6ac7-4564-82bc-d9638ac3125c" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:07 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-59daea5a-6ac7-4564-82bc-d9638ac3125c" acquired by "delete_volume" :: waited 0.009s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea" returned: 0 in 0.421s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.630s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1804997084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084c71a0-c413-4bc7-837c-8436aa84b0c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:44:06Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Creating volume 084c71a0-c413-4bc7-837c-8436aa84b0c5 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:44:07 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[41aecac0-bdf4-4d58-bf95-bf3da228ffdc]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:07 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5 1073741824 Apr 10 10:44:07 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afb702d3-8361-4308-a717-072ec15a90a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86e37938-8488-4a34-a955-302e53fd8eea', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0292cb1a-ff92-4c0c-8fa2-87d815fcc0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:07 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume volume-86e37938-8488-4a34-a955-302e53fd8eea (86e37938-8488-4a34-a955-302e53fd8eea): created successfully Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0292cb1a-ff92-4c0c-8fa2-87d815fcc0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (fc30b249-ba30-4952-b17e-fd9d5e3d428e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:07 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-c7f405f1-5517-4da0-b7f8-f792e525c1fd tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created volume successfully. Apr 10 10:44:07 devstack sudo[90294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c Apr 10 10:44:07 devstack sudo[90294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:07 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5 1073741824" returned: 0 in 0.459s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:07 devstack sudo[90302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5 Apr 10 10:44:07 devstack sudo[90302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:07 devstack sudo[90294]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c" returned: 0 in 0.509s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:07 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:07 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c Apr 10 10:44:07 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:08 devstack sudo[90302]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5" returned: 0 in 0.415s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.305s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2126607580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b13d4a3-6f12-4e38-ad7a-56cb486b6672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:44:06Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Creating volume 8b13d4a3-6f12-4e38-ad7a-56cb486b6672 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:44:08 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe6c2711-4fcc-49c1-afa6-f4ba048d4e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084c71a0-c413-4bc7-837c-8436aa84b0c5', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:08 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672 1073741824 Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ee127c-1c82-450a-b2f5-b861c731d08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:08 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:08 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume volume-084c71a0-c413-4bc7-837c-8436aa84b0c5 (084c71a0-c413-4bc7-837c-8436aa84b0c5): created successfully Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ee127c-1c82-450a-b2f5-b861c731d08c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (866c9193-0d40-4d71-b133-44b619d107c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:08 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-ca48940d-700b-422e-8b36-bc631f01bd90 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created volume successfully. Apr 10 10:44:08 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-59daea5a-6ac7-4564-82bc-d9638ac3125c" returned: 0 in 0.467s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-quobyte-59daea5a-6ac7-4564-82bc-d9638ac3125c" released by "delete_volume" :: held 1.020s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Created reservations ['a90cb511-93f4-480a-bb17-4705b0ce7ca3', '5047cf16-22e2-445c-a519-b176a8a1b649', 'a4f50e73-d911-47c5-8dbf-0c5a6c1988c2', '76e35db2-dd1b-451b-8a71-9f63d7ea9df6'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:08 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:44:08 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:08 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672 1073741824" returned: 0 in 0.536s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:08 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:08 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672 Apr 10 10:44:08 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:08 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.462s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:09 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Deleted volume successfully. Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-4b9add84-5455-4c37-a72c-ebd7ec2e1176 tempest-VolumeDependencyTests-671945497 None] Lock "cinder-59daea5a-6ac7-4564-82bc-d9638ac3125c-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:09 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672" returned: 0 in 0.427s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.141s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T08:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2091377346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6749940b-1d29-485f-a6fe-0988d871c557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed6c525d9f084bd0ac7aad1951f0bc9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T08:44:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T08:44:06Z,use_quota=True,user_id='5637b78a5a6c4d16b18f5e1a7ebea773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4f4d1c38-a758-4653-86bf-3ec97ef5d9a7),volume_type_id=4f4d1c38-a758-4653-86bf-3ec97ef5d9a7)}" {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.remotefs [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Creating volume 6749940b-1d29-485f-a6fe-0988d871c557 {{(pid=82038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Selected osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e as target Quobyte volume. {{(pid=82038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 10:44:09 devstack cinder-volume[82038]: INFO cinder.volume.drivers.remotefs [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] casted to osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557 1073741824 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b00a3bb-0ab4-403e-a927-03c6c40c2737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa4ecd7-6342-499c-b12b-249b552a9e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:09 devstack sudo[90319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557 1073741824 Apr 10 10:44:09 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:09 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672 (8b13d4a3-6f12-4e38-ad7a-56cb486b6672): created successfully Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fa4ecd7-6342-499c-b12b-249b552a9e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (20114418-551a-47cc-923c-40ac668f8023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:09 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-0732180b-5de5-406e-9eb6-18f94d966c8e tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created volume successfully. Apr 10 10:44:09 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557 1073741824" returned: 0 in 0.528s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:09 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:09 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557 Apr 10 10:44:09 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:10 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557" returned: 0 in 0.483s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'} {{(pid=82038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ffa5c92-6733-4642-a952-08a915d24d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6749940b-1d29-485f-a6fe-0988d871c557', 'volume_size': 1}' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73637263-639f-480b-bd58-de7400aaecc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 10:44:10 devstack cinder-volume[82038]: INFO cinder.volume.flows.manager.create_volume [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Volume volume-6749940b-1d29-485f-a6fe-0988d871c557 (6749940b-1d29-485f-a6fe-0988d871c557): created successfully Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73637263-639f-480b-bd58-de7400aaecc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82038) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Flow 'volume_create_manager' (ae8d8f48-6722-4a34-b200-3a6a4ec8f031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82038) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 10:44:10 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-039c2cdd-0156-4608-9567-0f9617b49a2c tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created volume successfully. Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-6749940b-1d29-485f-a6fe-0988d871c557-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-6749940b-1d29-485f-a6fe-0988d871c557-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-quobyte-6749940b-1d29-485f-a6fe-0988d871c557" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-6749940b-1d29-485f-a6fe-0988d871c557" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[28893d76-f495-4b88-b290-2cb09f074420]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:10 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:10 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557 Apr 10 10:44:10 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:11 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557" returned: 0 in 0.448s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:11 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557 Apr 10 10:44:11 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:11 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-6749940b-1d29-485f-a6fe-0988d871c557" returned: 0 in 0.413s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-6749940b-1d29-485f-a6fe-0988d871c557" released by "delete_volume" :: held 0.899s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created reservations ['11f84014-ed74-41e9-ab08-7db6a607b0d3', '7638274c-d8ad-478c-ae31-7ec691c6d2b6', 'c9ed9b48-68e3-44e6-ac72-d8d62c81c486', '27d0c863-8206-4b95-a947-997690729c92'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:11 devstack sudo[90335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:44:11 devstack sudo[90335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-8b13d4a3-6f12-4e38-ad7a-56cb486b6672-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-8b13d4a3-6f12-4e38-ad7a-56cb486b6672-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-quobyte-8b13d4a3-6f12-4e38-ad7a-56cb486b6672" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-8b13d4a3-6f12-4e38-ad7a-56cb486b6672" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b17a769-e9cf-406d-aa1b-0e26913984c8]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:11 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:11 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672 Apr 10 10:44:11 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:12 devstack sudo[90335]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.422s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:12 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Deleted volume successfully. Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-a351b9c2-a95f-45e0-b23c-c1bd6b1751ce tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-6749940b-1d29-485f-a6fe-0988d871c557-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:12 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672" returned: 0 in 0.476s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:12 devstack sudo[90344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672 Apr 10 10:44:12 devstack sudo[90344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:12 devstack sudo[90344]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-8b13d4a3-6f12-4e38-ad7a-56cb486b6672" returned: 0 in 0.395s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-8b13d4a3-6f12-4e38-ad7a-56cb486b6672" released by "delete_volume" :: held 0.901s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created reservations ['ecf10c35-3885-4310-aab7-85d5fa5cb1e6', 'd9a6fdd3-4a41-4e51-806c-08c4f573ebd7', '40fe64e3-0121-480a-8a0a-ddb3ca834be9', '2536e905-b48c-4fdd-8f0f-1eaddfd1a237'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:12 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:44:12 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-084c71a0-c413-4bc7-837c-8436aa84b0c5-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-084c71a0-c413-4bc7-837c-8436aa84b0c5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-quobyte-084c71a0-c413-4bc7-837c-8436aa84b0c5" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-084c71a0-c413-4bc7-837c-8436aa84b0c5" acquired by "delete_volume" :: waited 0.006s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[05787ea7-b615-44cb-be53-7961da809f96]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:12 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:12 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5 Apr 10 10:44:12 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:13 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.418s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:13 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Deleted volume successfully. Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-aea5b62b-31d4-4362-9a76-eb83f5c2cfa3 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-8b13d4a3-6f12-4e38-ad7a-56cb486b6672-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:13 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5" returned: 0 in 0.463s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:13 devstack sudo[90355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5 Apr 10 10:44:13 devstack sudo[90355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:13 devstack sudo[90355]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-084c71a0-c413-4bc7-837c-8436aa84b0c5" returned: 0 in 0.418s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-084c71a0-c413-4bc7-837c-8436aa84b0c5" released by "delete_volume" :: held 0.911s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created reservations ['b2faa124-2f8a-4042-bd92-d0fb27652140', '76382955-627a-4a77-8cc5-b2cea93f1d56', '73cccd9c-2a49-4c13-93af-da2f176dfb32', '0a3f23e1-e023-494f-9acf-02c76e1c74f0'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:13 devstack sudo[90358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:44:13 devstack sudo[90358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-86e37938-8488-4a34-a955-302e53fd8eea-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-86e37938-8488-4a34-a955-302e53fd8eea-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-quobyte-86e37938-8488-4a34-a955-302e53fd8eea" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-86e37938-8488-4a34-a955-302e53fd8eea" acquired by "delete_volume" :: waited 0.007s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb019df-59c4-4d8a-b8e0-9c93fec39f4e]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:13 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:14 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea Apr 10 10:44:14 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:14 devstack sudo[90358]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.401s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:14 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:14 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Deleted volume successfully. Apr 10 10:44:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-b3f827d7-6222-446e-9349-0ca357177231 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-084c71a0-c413-4bc7-837c-8436aa84b0c5-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:14 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea" returned: 0 in 0.499s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:14 devstack sudo[90366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea Apr 10 10:44:14 devstack sudo[90366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:14 devstack sudo[90366]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:14 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-86e37938-8488-4a34-a955-302e53fd8eea" returned: 0 in 0.441s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:14 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-86e37938-8488-4a34-a955-302e53fd8eea" released by "delete_volume" :: held 0.959s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:14 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created reservations ['9bab9724-ccb5-4679-9846-8531d9c9f0b5', '4e2cdb4d-6c69-464d-8ec9-c333b8dc61ab', '1633b17a-cda9-4387-89d8-2d6d1a1056d4', '2b19113e-2175-484f-a77f-93251f9358b0'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:15 devstack sudo[90369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:44:15 devstack sudo[90369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-9b7ac5d1-7ba7-4464-ad43-7c75620b5620-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-9b7ac5d1-7ba7-4464-ad43-7c75620b5620-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-quobyte-9b7ac5d1-7ba7-4464-ad43-7c75620b5620" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-9b7ac5d1-7ba7-4464-ad43-7c75620b5620" acquired by "delete_volume" :: waited 0.006s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d9aaec-2489-48c9-ad5e-d6926401ca5a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:15 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620 Apr 10 10:44:15 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:15 devstack sudo[90369]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.401s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:15 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Deleted volume successfully. Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=200,cinder:UPDATE=278,cinder:INSERT=76,cinder:DELETE=24 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-5617de54-3f00-4566-bba7-196ffc44ea0f tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-86e37938-8488-4a34-a955-302e53fd8eea-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:15 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620" returned: 0 in 0.483s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:15 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620 Apr 10 10:44:15 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:15 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-9b7ac5d1-7ba7-4464-ad43-7c75620b5620" returned: 0 in 0.395s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:15 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-9b7ac5d1-7ba7-4464-ad43-7c75620b5620" released by "delete_volume" :: held 0.906s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:UPDATE=296,cinder:SELECT=213,cinder:DELETE=28,cinder:INSERT=61 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created reservations ['c7b6bff6-43b9-40f9-947f-9e36bdefa8c9', '129e5d91-481d-4e0c-a466-b89c04857a34', 'c2e921ff-6fb7-406d-b3f5-e5807e6097a4', '74048a88-5a3a-4304-9680-40986512aedb'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:16 devstack sudo[90380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:44:16 devstack sudo[90380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-12f97125-c364-4302-a3f2-faae3b1caa66-delete_volume" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-12f97125-c364-4302-a3f2-faae3b1caa66-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "cinder-quobyte-12f97125-c364-4302-a3f2-faae3b1caa66" by "delete_volume" {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-12f97125-c364-4302-a3f2-faae3b1caa66" acquired by "delete_volume" :: waited 0.008s {{(pid=82038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG oslo.privsep.daemon [-] privsep: reply[83577adf-b0f7-4828-854d-06424518d02a]: (4, 'qcow2') {{(pid=82807) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:16 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66 Apr 10 10:44:16 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:16 devstack sudo[90380]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.411s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:16 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Deleted volume successfully. Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-3c7ba7d4-e26e-41d7-b5b9-591121c5b60b tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-9b7ac5d1-7ba7-4464-ad43-7c75620b5620-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:16 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66" returned: 0 in 0.479s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:16 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:16 devstack sudo[90388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66 Apr 10 10:44:16 devstack sudo[90388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:17 devstack sudo[90388]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17/volume-12f97125-c364-4302-a3f2-faae3b1caa66" returned: 0 in 0.418s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-quobyte-12f97125-c364-4302-a3f2-faae3b1caa66" released by "delete_volume" :: held 0.921s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG cinder.quota [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Created reservations ['30b050a9-52e8-4d16-8531-817193fbb3e3', '31f73990-666a-4595-b430-a6553a288a4b', '6d4771a8-e5ee-48ea-93da-c56b74ee1db7', '788ad13e-3924-49cd-9654-7f9e97fc189e'] {{(pid=82038) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e': None} {{(pid=82038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG cinder.volume.drivers.quobyte [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-847462b2-6a02-4a54-b375-1cd7d259b13e'] {{(pid=82038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.lockutils [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82038) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 10:44:17 devstack sudo[90391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17 Apr 10 10:44:17 devstack sudo[90391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 10:44:17 devstack sudo[90391]: pam_unix(sudo:session): session closed for user root Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG oslo_concurrency.processutils [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/2969c4e97703deb7f7513c284b626f17" returned: 0 in 0.420s {{(pid=82038) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG cinder.manager [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Notifying Schedulers of capabilities ... {{(pid=82038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 10:44:17 devstack cinder-volume[82038]: INFO cinder.volume.manager [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Deleted volume successfully. Apr 10 10:44:17 devstack cinder-volume[82038]: DEBUG cinder.coordination [None req-1611937e-3906-4eca-885b-241587dfe876 tempest-CreateVolumesFromSourceVolumeTest-1320204456 None] Lock "cinder-12f97125-c364-4302-a3f2-faae3b1caa66-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82038) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 10:44:27 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:UPDATE=10,cinder:SELECT=5,cinder:INSERT=4 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 10:44:27 devstack cinder-volume[82038]: DEBUG dbcounter [-] [82038] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=82038) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}